Automatically extract the full article text from a media webpage

[digitaldutch]

Currently our spider uses the JSON-LD article tag to find the full text of a media article web page. Problem is that few media websites support this tag. Consequently our volunteers have to manually copy and page the text from the web page to our input field.

Any method (scraping, not yet used tags) that helps to automatically read the full text is welcome.

As roaddanger.org is multilingual, it would be nice if the full text extractor supports multiple languages.