Skip to main content
These requirements apply to every file-based connector: Amazon S3 and Google Cloud Storage. The setup wizard asks you to confirm them before you start — they’re the contract a sync relies on.

​
Supported file formats

The self-serve setup wizard reads these formats:
CSV must be comma-separated. A semicolon-, tab-, or pipe-delimited file is refused at setup, and the wizard shows the header it read. Re-export with commas, or switch to Parquet.
Avro, ORC, Delta Lake, and Iceberg are supported when the connection is set up with the Auxia team rather than through the wizard. Contact your Auxia point of contact. Compression. Whole-file compression such as .csv.gz or .parquet.gz is not supported, and neither are archives such as .tar.gz. Compression inside a Parquet file may also not work out of the box — confirm the codec with your Auxia contact before committing to a compressed format. Encryption. Bucket-level server-side encryption (for example S3 SSE-S3 and SSE-KMS) is transparent to Auxia. Client-side encrypted files (such as PGP) and encrypted columns are supported only in limited cases — bring your specific case to your Auxia contact.

​
One folder per table

Each table you want Auxia to ingest must live in its own folder. In the wizard you select the folders that are tables — not a parent folder that holds several of them.
Don’t select the parent folder (auxia-export/ above). Auxia would treat every file underneath it as a single table, and the different datasets can’t be separated afterwards.
All files within one table folder should share the same schema. A table’s schema is read from its newest file, and new files may add columns over time. Table folders can sit several levels deep in the bucket — for example under a warehouse export path. You can type a prefix in the wizard to jump straight to them.

​
Date folders

Auxia reads date-partitioned folders efficiently: each run reads only the newest day’s folder. Use a key=value folder name with the date:
The key (dt above) is the partition folder prefix you enter during setup — the prefix only, with no =, /, or spaces.

​
Supported date formats

Ambiguous dates are confirmed explicitly. A folder named 03-04-2026 could be 3 April or 4 March. Choosing wrong doesn’t fail — it silently reads the wrong day, every day — so the wizard blocks until you confirm the format.
Dates that appear only in file names (not folder names) aren’t detected. Without date folders, the whole folder is copied as a snapshot on each run.

​
Append-only files

  • Once written, a file must never be overwritten, modified, or deleted.
  • To add or correct data, write a new file with a new name.

​
Access

You grant Auxia read-only access to the bucket. Auxia never writes to your storage. See each connector’s setup guide for the exact grant:

Amazon S3 setup guide

Google Cloud Storage setup guide