summaryrefslogtreecommitdiffstatshomepage
path: root/tests/scrapers (follow)
Commit message (Collapse)AuthorAgeLines
* backend/lint: Do not shadow certain builtinsWolfgang Müller12 days-9/+9
| | | | | | | | | | | | This commit enables ruff's flake8-builtin linter that emits warnings when builtin functions are shadowed. This is useful for builtins like "dict", "list", or "str" which we use often. Given the nature of this program we historically rely a lot on the usage of "id", "hash", and "filter" as variable names which also shadow Python builtins. For now let's ignore those, we have not used any of them in our code and the impact to the codebase would be considerable. This might be revisited in the future.
* backend/scraper: Have collect() ignore None resultsWolfgang Müller13 days-0/+15
| | | | | | If a parser function returned None we yield it regardless, even though it won't have any impact further down the line. Instead clean up the collect() stream as early as possible.
* backend/tests: Add test for open_archive_fileWolfgang Müller13 days-1/+40
|
* backend/scraper: Add parser methods for LanguageWolfgang Müller13 days-0/+33
| | | | | | We can expect a number of scraper sources to either give languages as ISO 639-3 or as their English name, so it makes sense to implement a simple parser method on our side.
* backend/lint: Fix import formattingWolfgang Müller13 days-0/+1
|
* Initial commit0.1.0Wolfgang Müller2024-03-05-0/+214