merari42@lemmy.world to Programmer Humor@programming.dev · 2 days agoWhat Drove You to Madness?lemmy.worldimagemessage-square43fedilinkarrow-up1591arrow-down162
arrow-up1529arrow-down1imageWhat Drove You to Madness?lemmy.worldmerari42@lemmy.world to Programmer Humor@programming.dev · 2 days agomessage-square43fedilink
minus-squarewise_pancakelinkfedilinkarrow-up6·edit-22 days agoMost recently: I had to parse an html table with a column of printed python dictionaries, the dicts wrapped a mixed delimiter list of SQL statements of various types. It’s truly an abomination. I’ve never had to use pythons AST module to parse data before…
minus-squarewise_pancakelinkfedilinkarrow-up2·edit-22 days agoIt was 900mb raw and compressed to 1.6mb after cleaning. That’s how much junk data there was. Combing through that log is the only way to prove and identify where a big was introduced so I can fix it.
Most recently:
I had to parse an html table with a column of printed python dictionaries, the dicts wrapped a mixed delimiter list of SQL statements of various types.
It’s truly an abomination.
I’ve never had to use pythons AST module to parse data before…
🤮
It was 900mb raw and compressed to 1.6mb after cleaning.
That’s how much junk data there was.
Combing through that log is the only way to prove and identify where a big was introduced so I can fix it.