Bulk update in rails with mongodb -

-

i have scenario need update 7k records in mongodb. query 

document.all.each |d| d.pages_enabled_count = d.pages.where(:disabled => false).count d.pages_enabled_to_query_count = d.pages.where(:disabled => false , :to_query => true).count d.pages_enabled_to_rescan_count = d.pages.where(:disabled => false , :to_rescan => true).count d.pages_enabled_to_retag_count = d.pages.where(:disabled => false , :to_retag => true).count d.save end

it looks query take more 2 hrs!! 1 update takes around 1.6 sec. way optimize this?

mongodb (388.3ms) test['$cmd'].find({"count"=>"pages", "query"=>{:deleted_at=>nil,  "document_id"=>bson::objectid('51cd1c435329b64899000035'), :disabled=>false}, "fields"=>nil}).limit(-1) mongodb (388.5ms) test['$cmd'].find({"count"=>"pages", "query"=>{:deleted_at=>nil, "document_id"=>bson::objectid('51cd1c435329b64899000035'), :disabled=>false, :to_query=>true}, "fields"=>nil}).limit(-1) mongodb (408.0ms) test['$cmd'].find({"count"=>"pages", "query"=>{:deleted_at=>nil, "document_id"=>bson::objectid('51cd1c435329b64899000035'), :disabled=>false, :to_rescan=>true}, "fields"=>nil}).limit(-1) mongodb (390.9ms) test['$cmd'].find({"count"=>"pages", "query"=>{:deleted_at=>nil, "document_id"=>bson::objectid('51cd1c435329b64899000035'), :disabled=>false, :to_retag=>true}, "fields"=>nil}).limit(-1) mongodb (0.9ms) test['users'].find({"owned_document_id"=>bson::objectid('51cd1c435329b64899000035')}).limit(-1).sort([[:_id, :asc]]) mongodb (0.1ms) test['documents'].update({"_id"=>bson::objectid('51cd1c435329b64899000035')}, {"$set"=>{"pages_enabled_count"=>18, "pages_enabled_to_query_count"=>0, "pages_enabled_to_rescan_count"=>0, "pages_enabled_to_retag_count"=>0, "updated_at"=>2013-08-20 04:35:47 utc}})

you can do

document.all.each |d|   d.update({ :pages_enabled_count => d.pages.where(:disabled => false).count,              :pages_enabled_to_query_count => d.pages.where(:disabled => false, :to_query => true).count,              :pages_enabled_to_rescan_count => d.pages.where(:disabled => false, :to_rescan => true).count,              :pages_enabled_to_retag_count => d.pages.where(:disabled => false, :to_retag => true).count           }) end

this speed little bit because no callbacks or validations run.

if 1 time activity, consider doing on mongodb without using mongoid


Comments

Post a Comment

Popular posts from this blog

java - JavaFX 2 slider labelFormatter not being used -

-
i have following code not label slider "foo50", etc... 1 expect setlabelformatter call, instead seems have no effect (the slider labelled 50, 100, etc , println's dont run). there missing? not implemented in default 2.2 skin? using oracle java 7 package javafxbugtest; import javafx.application.application; import javafx.scene.*; import javafx.scene.control.*; import javafx.stage.*; import javafx.util.stringconverter; public class javafxbugtest extends application { @override public void start(final stage primarystage) { slider cp = new slider(); cp.setlabelformatter(new stringconverter<double>() { @override public string tostring(double t) { system.out.println("nope?"); return "foo" + t.tostring(); } @override public double fromstring(string string) { system.out.println("he
Read more

Detect support for Shoutcast ICY MP3 without navigator.userAgent in Firefox? -

-
the current version of mozilla firefox 23.0.1, version not support play mp3 shoutcast streams tcp port different 80 (most common 8000 shoutcast 1.9.8). i use flash when mp3 support not available in html5 audio, way detect is: try{ var = document.createelement('audio'); r = !!(a.canplaytype && !!a.canplaytype("audio/mpeg; codecs=mp3").replace(/^no$/,'')) }catch(e){ r = false; } the support mp3 shoutcast streams in firefox added in version 24 . a.canplaytype("audio/mpeg; codecs=mp3") = in chrome , firefox, chrome support, firefox not support, due current code detect not work firefox. the current version of jquery support ie 6 1.10.2, version not has .browser i think "stylized" way testing features , not querying browsers / versions, notwithstanding here see hard not violate "principle". what "stylized" way of detect mp3 icy support without navigator.useragent in firefox? ther
Read more

web - SVG not rendering properly in Firefox -

-
i have problem svg renderring in firefox. whilst works in safari, chrome or in ie, doesn't work in firefox. inspecting element seems layers there, background visible if it's z-index higher z-index of others. rendered in firefox: svg logo in firefox link original source file: svg file thanks help. ps: used sketch 3 export svg. if helps somehow. you're experiencing bug 995813 . i fixed bug time ago change still making way through release process example display correctly firefox 31 onwards released on 22 july 2014. in meantime if move fill="white" <mask> element child <use> element work around firefox bug.
Read more