Skip to content

Connectors ​

DocIntel provides source connectors for batch-pulling documents from enterprise platforms, plus a generic webhook endpoint for push-based ingestion.

Available connectors ​

ConnectorAuthProtocol
Microsoft SharePointAzure AD service principalBatch pull + change webhooks
Atlassian ConfluenceAPI tokenBatch pull by space key
AWS S3IAM credentials / instance profileBatch pull with prefix + glob filter
Generic webhookBearer token (header)POST file bytes or URL

SharePoint ​

Trigger a full SharePoint library sync via the API:

bash
curl -X POST http://localhost:8200/connectors/sync/sharepoint \
  -H "Authorization: Bearer $API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "site_url": "https://myorg.sharepoint.com/sites/mysite",
    "library": "Documents",
    "profile": "general",
    "recursive": true
  }'

Configuration ​

VariableDescription
SHAREPOINT__TENANT_IDAzure AD tenant ID
SHAREPOINT__CLIENT_IDApp registration client ID
SHAREPOINT__CLIENT_SECRETApp registration client secret

Change webhooks ​

SharePoint can also push change notifications to DocIntel:

bash
POST /connectors/webhook/sharepoint

The webhook validates the SharePoint validation token on subscription, then processes file change events.

Confluence ​

Sync all pages in a Confluence space:

bash
curl -X POST http://localhost:8200/connectors/sync/confluence \
  -H "Authorization: Bearer $API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "base_url": "https://myorg.atlassian.net/wiki",
    "space_key": "ENG",
    "profile": "scientific"
  }'

Configuration ​

VariableDescription
CONFLUENCE__USERAtlassian account email
CONFLUENCE__API_TOKENAtlassian API token

Confluence webhooks ​

bash
POST /connectors/webhook/confluence

Receives page create/update events from Confluence webhooks.

AWS S3 ​

Sync documents from an S3 bucket with optional prefix and glob filter:

bash
curl -X POST http://localhost:8200/connectors/sync/s3 \
  -H "Authorization: Bearer $API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "bucket": "my-bucket",
    "prefix": "reports/2026/",
    "glob": "*.pdf",
    "profile": "financial"
  }'

Authentication ​

S3 uses standard AWS credential chain:

  • Environment variables (AWS_ACCESS_KEY_ID, AWS_SECRET_ACCESS_KEY)
  • Instance profile (IAM role on EC2/ECS)
  • Shared credentials file

Generic webhook ​

For any external system, POST a file or URL reference:

bash
# POST a URL reference
curl -X POST http://localhost:8200/connectors/webhook \
  -H "Authorization: Bearer $API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "url": "https://internal-dms.example.com/doc/12345.docx",
    "profile": "contract",
    "metadata": {
      "source": "my-dms",
      "doc_id": "12345"
    }
  }'

Incremental processing ​

All connectors benefit from incremental processing. When a connector sync re-encounters unchanged documents, they are skipped entirely — zero LLM cost.

ConnectorWithout incrementalWith incremental
SharePoint syncRe-processes all docsOnly new/modified docs
Confluence syncRe-processes all pagesOnly updated pages
S3 syncRe-processes all objectsOnly new objects
Webhook retryFull extractionInstant cached response

License tier requirements ​

FeatureBetaProEnterprise
S3 connector✅✅✅
Webhook✅✅✅
SharePoint❌✅✅
Confluence❌✅✅

Beta-tier licenses include S3 and webhook connectors. SharePoint and Confluence require Pro or Enterprise. See pricing →

Purple8 DocIntel v0.12.5 · Universal Document Intelligence · NVIDIA Inception Member · Red Hat Technology Partner.