Skip to content

feat(persistence): introduce AWS S3 backend #42

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
smunini merged 7 commits into from
Mar 4, 2026
Merged

feat(persistence): introduce AWS S3 backend #42

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
7 commits
Select commit Hold shift + click to select a range
ee03734
feat(persistence): add AWS S3 backend with CRUD, versioning, bulk ops…
aacruzgon Feb 25, 2026
06a7647
deleted discussion file
aacruzgon Feb 25, 2026
cd92540
Added s3 to the inferno test matrix
aacruzgon Feb 25, 2026
5e3143a
docs(persistence): consolidate S3 backend docs into main README [skip…
smunini Feb 25, 2026
0764362
Added comments
smunini Mar 4, 2026
31f9e65
fix(rest): improve batch/transaction response FHIR spec compliance
smunini Mar 4, 2026
e7aaf06
feat(s3): integrate S3 backend into HFS server and CI
smunini Mar 4, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
25 changes: 21 additions & 4 deletions .github/workflows/inferno.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,7 +1,7 @@
name: Inferno US Core Test Suite

on:
workflow_dispatch: # Manual trigger only for initial implementation
workflow_dispatch: # Manual trigger only for initial implementation

env:
CARGO_TERM_COLOR: always
Expand All @@ -12,6 +12,8 @@ env:
# Remote Docker host (set via GitHub repository secrets or variables; leave unset for local Docker)
DOCKER_HOST: ${{ secrets.DOCKER_HOST }}
DOCKER_HOST_IP: ${{ secrets.DOCKER_HOST_IP }}
# S3 backend configuration (optional; S3 tests are skipped when not set)
HFS_S3_BUCKET: ${{ secrets.HFS_S3_BUCKET || vars.HFS_S3_BUCKET }}

jobs:
build:
Expand All @@ -35,7 +37,7 @@ jobs:
echo 'rustflags = ["-C", "link-arg=-fuse-ld=lld", "-C", "link-arg=-Wl,-zstack-size=8388608"]' >> ~/.cargo/config.toml

- name: Build HFS
run: cargo build -p helios-hfs --features R4,sqlite,elasticsearch,postgres
run: cargo build -p helios-hfs --features R4,sqlite,elasticsearch,postgres,s3

- name: Upload HFS binary
uses: actions/upload-artifact@v4
Expand All @@ -52,8 +54,16 @@ jobs:
fail-fast: false
max-parallel: 3
matrix:
suite_id: [us_core_v311, us_core_v400, us_core_v501, us_core_v610, us_core_v700, us_core_v800]
backend: [sqlite, sqlite-elasticsearch, postgres]
suite_id:
[
us_core_v311,
us_core_v400,
us_core_v501,
us_core_v610,
us_core_v700,
us_core_v800,
]
backend: [sqlite, sqlite-elasticsearch, postgres, s3]
include:
- { suite_id: us_core_v311, version_label: "v3.1.1" }
- { suite_id: us_core_v400, version_label: "v4.0.0" }
Expand Down Expand Up @@ -188,6 +198,7 @@ jobs:
exit 1

- name: Start HFS server
if: matrix.backend != 's3' || env.HFS_S3_BUCKET != ''
run: |
HFS_LOG="/tmp/hfs-${{ matrix.suite_id }}-${{ matrix.backend }}.log"
echo "HFS_LOG=$HFS_LOG" >> $GITHUB_ENV
Expand All @@ -204,6 +215,12 @@ jobs:
HFS_PG_USER=helios \
HFS_PG_PASSWORD=helios \
./target/debug/hfs --log-level info --port $HFS_PORT --host 0.0.0.0 > "$HFS_LOG" 2>&1 &
elif [ "${{ matrix.backend }}" = "s3" ]; then
HFS_STORAGE_BACKEND=s3 \
HFS_S3_BUCKET=${{ secrets.HFS_S3_BUCKET || vars.HFS_S3_BUCKET }} \
HFS_S3_VALIDATE_BUCKETS=false \
AWS_REGION=${{ secrets.AWS_REGION || vars.AWS_REGION || 'us-east-1' }} \
./target/debug/hfs --log-level info --port $HFS_PORT --host 0.0.0.0 > "$HFS_LOG" 2>&1 &
else
./target/debug/hfs --database-url :memory: --log-level info --port $HFS_PORT --host 0.0.0.0 > "$HFS_LOG" 2>&1 &
fi
Expand Down
Loading
Loading