What is Hudson doing with my Python script? -

-

i developing python script (here after script) searches through large log files search string. in normal use, called hudson front end.

about hudson interface:
hudson job creates temporary batch file on connected virtual machine (vm) calls script , passes parameters. have had hundreds of successful instances using setup, creating error.

about script:
log files contained in dozens of compressed .tgz files. script searches each log in each .tgz file.
1 of command line args script accepts true/false parameter called process_in_parallel. if process_in_parallel set true, each .tgz file searched in own thread (using multiprocessing module). if process_in_parallel set false, each .tgz file searched in sequence (using loop).

what works:

  1. i have batch file on vm use testing script. can use .bat call script process_in_parallel set either (1a) true or (1b) false. of course, runs faster when true (about 4x faster).
    have quadruple-checked .bat passes same parameters script hudson, , in same order. have added line script logs input parameters file, , have found hudson indeed passing correct parameters in correct order.
  2. i can use hudson call script process_in_parallel set false.
  3. i have tested current iteration of script using above 3 test cases multiple times (even using multiple configurations of other parameters), successfully.

what doesn't work:
if use hudson call script process_in_parallel set true, strange error. here traceback: 

traceback (most recent call last):   file "f:\scripts\parse_logfiles_archive\parselogs_archive_8-19-13.py", line 40, in main       searchhits = searchtarlist(searchdir, newdirectory, argv)   file "f:\scripts\parse_logfiles_archive\parselogs_archive_8-19-13.py", line 163, in searchtarlist       hits = processpool.map(searchtar, tarmap)   file "e:\python27\lib\multiprocessing\pool.py", line 225, in map       return self.map_async(func, iterable, chunksize).get()   file "e:\python27\lib\multiprocessing\pool.py", line 522, in       raise self._value   ioerror: [errno 9] bad file descriptor

according research, error happens when python attempts read file opened in write mode.

my question:
there genius out there know both python , hudson enough know happening?


Comments

Post a Comment

Popular posts from this blog

Detect support for Shoutcast ICY MP3 without navigator.userAgent in Firefox? -

-
the current version of mozilla firefox 23.0.1, version not support play mp3 shoutcast streams tcp port different 80 (most common 8000 shoutcast 1.9.8). i use flash when mp3 support not available in html5 audio, way detect is: try{ var = document.createelement('audio'); r = !!(a.canplaytype && !!a.canplaytype("audio/mpeg; codecs=mp3").replace(/^no$/,'')) }catch(e){ r = false; } the support mp3 shoutcast streams in firefox added in version 24 . a.canplaytype("audio/mpeg; codecs=mp3") = in chrome , firefox, chrome support, firefox not support, due current code detect not work firefox. the current version of jquery support ie 6 1.10.2, version not has .browser i think "stylized" way testing features , not querying browsers / versions, notwithstanding here see hard not violate "principle". what "stylized" way of detect mp3 icy support without navigator.useragent in firefox? ther...
Read more

web - SVG not rendering properly in Firefox -

-
i have problem svg renderring in firefox. whilst works in safari, chrome or in ie, doesn't work in firefox. inspecting element seems layers there, background visible if it's z-index higher z-index of others. rendered in firefox: svg logo in firefox link original source file: svg file thanks help. ps: used sketch 3 export svg. if helps somehow. you're experiencing bug 995813 . i fixed bug time ago change still making way through release process example display correctly firefox 31 onwards released on 22 july 2014. in meantime if move fill="white" <mask> element child <use> element work around firefox bug.
Read more

java - JavaFX 2 slider labelFormatter not being used -

-
i have following code not label slider "foo50", etc... 1 expect setlabelformatter call, instead seems have no effect (the slider labelled 50, 100, etc , println's dont run). there missing? not implemented in default 2.2 skin? using oracle java 7 package javafxbugtest; import javafx.application.application; import javafx.scene.*; import javafx.scene.control.*; import javafx.stage.*; import javafx.util.stringconverter; public class javafxbugtest extends application { @override public void start(final stage primarystage) { slider cp = new slider(); cp.setlabelformatter(new stringconverter<double>() { @override public string tostring(double t) { system.out.println("nope?"); return "foo" + t.tostring(); } @override public double fromstring(string string) { system.out.println("he...
Read more