ppcomp: many updates, mainly for HTML5

[rtonsing]

Since I'm using a different file name, you should be able to switch easily for testing. I would still like to handle more footnote styles, but it will take time.

[tangledhelix]

Pulling in some notes that were included in the original submission

rtonsing said:

Not really an issue, but I'm not sure how else to submit it, I didn't think a pull request was appropriate.

This is humbly supplied for you to use or not as you see fit. The main purpose is to handle HTML5. I hope you are OK with the liberties I have taken.

Github project, file /ppcomp/ppcomp.py

I think this is at least ready for beta testing, if you wish to try it out. I have been comparing it to results from both PPWB and PPTools versions, and don't see any unexpected differences.

Changes:

• use html5parser to handle new tags.
• eliminate oe ligature transforms, treat same as ae.
• character "downgrades" such as curly quotes to straight is only done if one file is from rounds (projectID########.txt).
• --css-bold option has default of '=',
• changed boilerplate removal to latest format
• added super/subscript conversions (<sup>1</sup> to ¹ or ^1.
• I did a LOT of rewriting, mainly to make each functionality accessible for unit testing, partly code "cleanup" or just adapting to my style so I could understand it better.

--extract-footnotes needs work, but it shouldn't be any worse.

[tangledhelix]

Integrated and up for testing at https://dev.pptools.tangledhelix.com/

[tangledhelix]

I haven't closed this yet, by the way, because it only addresses part of the overall HTML5 support. I am leaving this PR open until I implement the rest, because I don't plan to merge this until the others are also ready.