For the complete documentation index, see llms.txt. This page is also available as Markdown.

Connectors overview

Connectors are configured, testable connections to your external data — databases, warehouses, object storage, REST APIs, and files — that back a governed source the engine can query.

A connector is a configured connection to an external system that backs a source. You register it once with the credentials and location of your data, Algenta tests that the connection is reachable, and from then on the engine reads from it under a typed, governed-data contract — never copying your warehouse, never reaching beyond what you configured.

Connectors are the capability of the data plane: you point Algenta at a table, an object, or an API, and the capability plane handles fetch, schema discovery, and field mapping. The credentials you supply are encrypted at rest, scoped to your organization, and used only to serve your own queries.

What a connector is

Every connector has three things:

  • A type — for example postgres, oracle, snowflake, s3, or rest_api.

  • A config — a JSON object whose fields depend on the type (a connection_string and query for SQL, a bucket and key for object storage, a url and data_path for REST).

  • A status — untested when first created, live once a real connection succeeds, or error with a message when it fails.

You can list every supported type at runtime:

curl -s https://api.algenta.ai/v1/connectors/types \
  -H "Authorization: Bearer $ALGENTA_API_KEY"

Categories

Algenta groups connector types into five families. Pick the one that matches where your data lives.

Category
What it reaches
Types

Database

Operational SQL and NoSQL stores

postgres, oracle, mysql, mssql, sqlite, redis, neo4j, elasticsearch

Warehouse

Analytical columnar engines

snowflake, bigquery, clickhouse, redshift

Object storage

Cloud blob stores

s3, gcs, azure

REST

Any HTTP/JSON API

rest, rest_api

File

Uploaded or inline CSV, TSV, JSON, Excel, Parquet

file

Object-storage and file connectors share the same parsers, so a Parquet object in s3 and an uploaded Parquet file land in the engine identically. SQL databases and warehouses share the same connection_string + query shape — the difference is the DSN scheme.

The lifecycle: create, test, browse, connect

A connector moves through four steps before the engine reads a single row. The full walkthrough lives in Connect your data; the short version:

  1. Create — POST /v1/connectors with a name, connector_type, and config. The connector is stored with status untested.

  2. Test — POST /v1/connectors/{id}/test opens a real connection (SELECT 1 for SQL, a HEAD for object storage, a sample fetch for REST). On success the status flips to live.

  3. Browse — GET /v1/connectors/{id}/browse lists the tables, datasets, or objects the connection exposes. A connector must be live before you can browse it.

  4. Connect — onboard the selected table or object as a source so the engine can query it under a contract.

You can also test or browse a config inline — without saving it — by posting it to POST /v1/connectors/test or POST /v1/connectors/browse. Inline previews are rate limited, so create a saved connector for any production workflow.

Pick your source

Each guide below walks one source end to end — the exact config fields, a tested example, and the browse output you should expect.

Reference and concepts

Next steps

If a connector reports error after a test, the message names the cause — bad credentials, an unreachable host, or a blocked egress destination. See Troubleshooting for the common failures and the shortest fix for each.

Last updated

Was this helpful?