gsoc26: Format Conversion Layer (Layer 2) + CLI refactor (#59, #61)

[DhanashreePetare]

Pull Request

Description

Implements Layer 2 (Format Conversion) for the Databus Python Client download pipeline, bringing it to feature parity with the Java client as described in Frey et al. Users can now convert between RDF serialization formats and tabular formats on-the-fly during download using the new --format flag. Also refactors the compression CLI (Issue #61) by replacing --convert-to / --convert-from with a single --compression flag.

Related Issues
Issue #59 (Format and Mapping Conversion Layer — Layer 2)
Issue #61 (Refactor CLI compression)

Type of change

• Bug fix (non-breaking change which fixes an issue)
• New feature (non-breaking change which adds functionality)
• Breaking change (fix or feature that would cause existing functionality to change)
• This change requires a documentation update
• Housekeeping

Checklist:

• My code follows the ruff code style of this project.
• I have performed a self-review of my own code
• I have commented my code, particularly in hard-to-understand areas
• I have made corresponding changes to the documentation (if applicable)
• I have added tests that prove my fix is effective or that my feature works
• New and existing unit tests pass locally with my changes
  • poetry run pytest - all tests passed
  • poetry run ruff check - no linting errors

What was added:

databusclient/filehandling/format.py — Layer 2 with TripleHandler, QuadHandler, TSDHandler classes using rdflib.Graph, rdflib.Dataset, and list[list[str]] as intermediate representations respectively. Each handler exposes read(), write(), and convert().

What was changed:

• --format flag replaces --convert-format, short aliases added (nt, ttl, rdf, xml, nq, jsonld)
• --compression replaces --convert-to / --convert-from (source auto-detected from file extension)
• Download pipeline: decompress once → convert → recompress once (was double decompress/recompress)
• Original file deleted after successful conversion
• Safe temp file handling via tempfile.NamedTemporaryFile

Tests:

• 9 format round trip tests in tests/test_format_round_trips.py (one per format, IR captured before conversion)

Closes #59
Closes #61

Summary by CodeRabbit

• New Features

  • Added RDF format conversion support for triples and quads across multiple formats
  • Added tabular format conversion support (CSV/TSV)
  • Updated download CLI with new --compression and --format options
  • Added automatic source compression detection during downloads

• Documentation

  • Updated README with revised CLI documentation and usage examples

• Tests

  • Added comprehensive format round-trip conversion tests
  • Added test data fixtures for multiple RDF formats

[coderabbitai]

Important

Review skipped

Auto reviews are disabled on base/target branches other than the default branch.

Please check the settings in the CodeRabbit UI or the .coderabbit.yaml file in this repository. To trigger a single review, invoke the @coderabbitai review command.

⚙️ Run configuration

Configuration used: Organization UI

Review profile: CHILL

Plan: Pro

Run ID: 20066ad6-d489-498c-88b3-e06d1d693913

You can disable this status message by setting the reviews.review_status to false in the CodeRabbit configuration file.

Use the checkbox below for a quick retry:

• 🔍 Trigger review

✨ Finishing Touches

🧪 Generate unit tests (beta)

• Create PR with unit tests

---

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

• X
• Mastodon
• Reddit
• LinkedIn

_{Comment @coderabbitai help to get the list of available commands and usage tips.}

[coderabbitai]

✅ Action performed

Review finished.

Note: CodeRabbit is an incremental review system and does not re-review already reviewed commits. This command is applicable only when automatic reviews are paused.

[Integer-Ctrl]

One last note: Right now, the --compression option can only be used to create compressed files. It would be cool if there were options like --compression none or --compression decompress. But if you'd rather work on the rest of the GSOC project first, that's fine too. In that case, I'll just create an issue to add decompression later on. Let me know if you’d like to do this now, later, or maybe not at all. I'm fine with your preference 👍

Overall, well done. I did discover a few edge cases, though, that need to be resolved. Once those are fixed, feel free to merge the pull request yourself if you feel confident. I trust you on that 😄 . Otherwise, let me know, and I'll test it again and merge it if everything works

[DhanashreePetare]

One last note: Right now, the --compression option can only be used to create compressed files. It would be cool if there were options like --compression none or --compression decompress. But if you'd rather work on the rest of the GSOC project first, that's fine too. In that case, I'll just create an issue to add decompression later on. Let me know if you’d like to do this now, later, or maybe not at all. I'm fine with your preference 👍

Overall, well done. I did discover a few edge cases, though, that need to be resolved. Once those are fixed, feel free to merge the pull request yourself if you feel confident. I trust you on that 😄 . Otherwise, let me know, and I'll test it again and merge it if everything works

Thanks for the review! I'll prefer fixing all 4 comments before merging itself (will push as soon as fixed), and considering this is the 1st milestone, I think you should go ahead and merge once you're done rechecking through it, I can continue doing to for later ones. 😄