python - Adding Multiple ZODB Databases Together -

-

i have 3 python object databases i've constructed through zodb module, merge one. reason have 3 , not 1 because each object belongs 1 of 3 populations, , added database once code conducted analysis of said object. analysis of each object can done in parallel. code takes few days run, prevent being week long endeavor, have 3 computers each processing objects 1 of 3 populations, , outputting single zodb database once has completed. couldn't have 3 computers adding analysis of objects different populations same database because of way zodb handles conflicts. essentially, until close database, locked inside.

my questions are: 1) how can merge multiple .fs database files single master database? structure of each database same - meaning dictionary structures same between each. example, mydb may represent zodb database structure of first population:

root.['mydb']['id123456']['property1']         ...  ['id123456']['property2']         ...       ...        ...  root.['mydb']['id123457']['property1']         ...  ['id123457']['property2']         ...       ...        ...  ...

where ellipsis represents more of same. names of keys 'property1', 'property2', etc., same each 'idxxxxxx' key within database, though values certaily vary.

2) have been smarter thing run code in parallel while still resulting in single zodb structure?

please let me know if clarification needed.

thanks!

the smarter thing have been use zeo share zodb storage among processes.

zeo shares zodb database across network , extends conflict resolution across multiple clients, can reside on same machine or elsewhere.

alternatively, use relstorage backend store zodb instead of using standard filestorage; backend uses traditional relational database provide concurrent access instead.

see zc.lockfile.lockerror in zodb usage examples either option.

the zodb data structures otherwise merely persisted python data structures; merging 3 zodb datastructures requires open each of databases , merging nested structures needed.


Comments

Post a Comment

Popular posts from this blog

java - JavaFX 2 slider labelFormatter not being used -

-
i have following code not label slider "foo50", etc... 1 expect setlabelformatter call, instead seems have no effect (the slider labelled 50, 100, etc , println's dont run). there missing? not implemented in default 2.2 skin? using oracle java 7 package javafxbugtest; import javafx.application.application; import javafx.scene.*; import javafx.scene.control.*; import javafx.stage.*; import javafx.util.stringconverter; public class javafxbugtest extends application { @override public void start(final stage primarystage) { slider cp = new slider(); cp.setlabelformatter(new stringconverter<double>() { @override public string tostring(double t) { system.out.println("nope?"); return "foo" + t.tostring(); } @override public double fromstring(string string) { system.out.println("he
Read more

Detect support for Shoutcast ICY MP3 without navigator.userAgent in Firefox? -

-
the current version of mozilla firefox 23.0.1, version not support play mp3 shoutcast streams tcp port different 80 (most common 8000 shoutcast 1.9.8). i use flash when mp3 support not available in html5 audio, way detect is: try{ var = document.createelement('audio'); r = !!(a.canplaytype && !!a.canplaytype("audio/mpeg; codecs=mp3").replace(/^no$/,'')) }catch(e){ r = false; } the support mp3 shoutcast streams in firefox added in version 24 . a.canplaytype("audio/mpeg; codecs=mp3") = in chrome , firefox, chrome support, firefox not support, due current code detect not work firefox. the current version of jquery support ie 6 1.10.2, version not has .browser i think "stylized" way testing features , not querying browsers / versions, notwithstanding here see hard not violate "principle". what "stylized" way of detect mp3 icy support without navigator.useragent in firefox? ther
Read more

web - SVG not rendering properly in Firefox -

-
i have problem svg renderring in firefox. whilst works in safari, chrome or in ie, doesn't work in firefox. inspecting element seems layers there, background visible if it's z-index higher z-index of others. rendered in firefox: svg logo in firefox link original source file: svg file thanks help. ps: used sketch 3 export svg. if helps somehow. you're experiencing bug 995813 . i fixed bug time ago change still making way through release process example display correctly firefox 31 onwards released on 22 july 2014. in meantime if move fill="white" <mask> element child <use> element work around firefox bug.
Read more