latest version crashing python on Mac OS X

[ghost]

Hi,

on Mac OS X,
latest version of pybloomfiltermmap
using python2.6 or python2.7
I get a crash using w3af :

---

Thread 10 Crashed:
0 pybloomfilter.so 0x0000000100d8ec76 __pyx_pw_13pybloomfilter_11BloomFilter_21add + 534
1 org.python.python 0x000000010088d1b1 PyEval_EvalFrameEx + 9185

[andresriancho]

Any news on this? I get several reports of w3af users seeing this issue. I actually try to give them a solution but the crash is so bad that not even a try/except block works.

[axiak]

Can you give me a reproducible test?

[ghost]

to me, the reproducible test is just having compiled and installed the
latest version of the pybloomfiltermmap
on Mac OS X 10.7.xx
and launching
w3af with it (on any website, e.g. google gruyere):
when the scan is starting,

when running it, it's clear it crashes in this thread.

$cat ../w3af_config/gruyere_config/gruyere_config.w3af
misc-settings
set maxDiscoveryTime 1200
set maxThreads 1
set maxDepth 200
set exportFuzzableRequests FuzzableRequests.csv
set fuzzFormComboValues t
back
plugins
output htmlFile, textFile, console, xmlFile, export_requests
back

plugins
auth generic
auth config generic
set username_field uid
set password_field pw
set auth_url http://google-gruyere.appspot.com/379735145474/login
set username toto
set password titi
set check_url http://google-gruyere.appspot.com/379735145474/snippets.gtl
set check_string logout
view
back
plugins
discovery webSpider
discovery config webSpider
set onlyForward True
#set ignoreRegex
(?i)._.|._75[rs]/senate/archive|.75[rs]/senate/members/dist[0-9]/pr|._req_inv[.]php|._req_svc[.]php|._req_survey01[.]php|._req_survey02[.]php|._survey001[.]php|._survey002[.]php|._req_signup01[.]php|._C820handler[.]php|._distemailhandler[.]php|._distemailhandler2[.]php|._FHdists[.]php|._FHwebadmin[.]php|._harrisQhandler[.]php|._ltgovhandler[.]php|._NLhandler[.]php|._QH090001[.]php|._QH120001[.]php|._QH230001[.]php|._QH230002[.]php|._SRChandler[.]php|._webadminhandler[.]php|._adminform[.]php|.logout.
back
back
target
set target http://google-gruyere.appspot.com/379735145474/
set targetOS unix
back
plugins
audit xss
audit config xss
set numberOfChecks 3
back
back
start

$ python2.7 ./w3af_console2.6 -s
../w3af_config/gruyere_config/gruyere_config.w3af
...
w3af>>> start
Segmentation fault: 11

Crashed Thread: 7

Exception Type: EXC_BAD_ACCESS (SIGSEGV)
Exception Codes: KERN_INVALID_ADDRESS at

VM Regions Near 0x418:
-->
__TEXT [ 4K] r-x/rwx SM=COW
/opt/local/Library/Frameworks/Python.framework/Versions/2.7/Resources/Python.app/Contents/MacOS/Python
.....
Thread 7 Crashed:
0 pybloomfilter.so
__pyx_pw_13pybloomfilter_11BloomFilter_21add

• 534 (bloomfilter.h:77)
  1 org.python.python PyEval_EvalFrameEx + 9185

#32

On Fri, Jul 5, 2013 at 4:46 AM, Michael Axiak [email protected]:

Can you give me a reproducible test?

—
Reply to this email directly or view it on GitHubhttps://github.com//issues/34#issuecomment-20499285
.

[andresriancho]

That's a way of reproducing it, but we don't want to make you work that hard. This should be enough:

from pybloomfilter import BloomFilter as CMmapFilter

temp_file = '/tmp/foobar'
bf = CMmapFilter(1000, 0.01, temp_file)
bf.add(1)
assert 1 in bf
assert 2 not in bf

[andresriancho]

ping! Any news / progress with this bug? It's a very important bug which makes your library unusable in mac 👎

[andresriancho]

@axiak could you please explain why this was closed? Did you fix the issue? Could you reference the commit for us to better understand?

[andresriancho]

ping? /me sets annoying mode to ON

[axiak]

It was fixed 7 months ago, and its working is heavily dependent on how it gets packaged. Apparently the last package broke it. I'll work on it this week.

[andresriancho]

I would like to better understand this, and to know if its related with #48 (0.3.12 pypi package is broken), could you link me to the code related to the #34 fix? Thanks!