ThreeGate/fetch/packetizer
welsberr e683c141a7 Expanded files with implementation stubs 2026-02-09 15:43:22 -05:00
..
README.md Expanded files with implementation stubs 2026-02-09 15:43:22 -05:00
packetizer_stub.py Expanded files with implementation stubs 2026-02-09 15:43:22 -05:00

README.md

FETCH Packetizer (Stub)

This directory contains the initial FETCH packetizer stub.

Current behavior

  • Produces schema-conforming Research Packets without network retrieval.
  • Intended for testing:
    • schemas
    • validators
    • quarantine behavior
    • CORE consumption

Why no network yet?

Network retrieval must be implemented only with:

  • managed egress proxy
  • allowlisted domains
  • strict normalization
  • deterministic validation + quarantine

The stub avoids accidentally violating the FETCH policy.

Usage

From repo root:

chmod +x fetch/packetizer/packetize_stub.py
export PYTHONPATH="$(pwd)"

python3 fetch/packetizer/packetize_stub.py \
  --source-kind url \
  --source-ref "https://arxiv.org/abs/2401.00001" \
  --title "Example: LLM Security Paper" \
  --authors "Doe, Jane; Smith, John" \
  --published-date "2024-01-01" \
  --out infra/volumes/handoff/inbound-to-core/RP-example.md