Connectors
DocIntel provides source connectors for batch-pulling documents from enterprise platforms, plus a generic webhook endpoint for push-based ingestion.
Available connectors
| Connector | Auth | Protocol |
|---|---|---|
| Microsoft SharePoint | Azure AD service principal | Batch pull + change webhooks |
| Atlassian Confluence | API token | Batch pull by space key |
| AWS S3 | IAM credentials / instance profile | Batch pull with prefix + glob filter |
| Generic webhook | Bearer token (header) | POST file bytes or URL |
SharePoint
Trigger a full SharePoint library sync via the API:
curl -X POST http://localhost:8200/connectors/sync/sharepoint \
-H "Authorization: Bearer $API_KEY" \
-H "Content-Type: application/json" \
-d '{
"site_url": "https://myorg.sharepoint.com/sites/mysite",
"library": "Documents",
"profile": "general",
"recursive": true
}'Configuration
| Variable | Description |
|---|---|
SHAREPOINT__TENANT_ID | Azure AD tenant ID |
SHAREPOINT__CLIENT_ID | App registration client ID |
SHAREPOINT__CLIENT_SECRET | App registration client secret |
Change webhooks
SharePoint can also push change notifications to DocIntel:
POST /connectors/webhook/sharepointThe webhook validates the SharePoint validation token on subscription, then processes file change events.
Confluence
Sync all pages in a Confluence space:
curl -X POST http://localhost:8200/connectors/sync/confluence \
-H "Authorization: Bearer $API_KEY" \
-H "Content-Type: application/json" \
-d '{
"base_url": "https://myorg.atlassian.net/wiki",
"space_key": "ENG",
"profile": "scientific"
}'Configuration
| Variable | Description |
|---|---|
CONFLUENCE__USER | Atlassian account email |
CONFLUENCE__API_TOKEN | Atlassian API token |
Confluence webhooks
POST /connectors/webhook/confluenceReceives page create/update events from Confluence webhooks.
AWS S3
Sync documents from an S3 bucket with optional prefix and glob filter:
curl -X POST http://localhost:8200/connectors/sync/s3 \
-H "Authorization: Bearer $API_KEY" \
-H "Content-Type: application/json" \
-d '{
"bucket": "my-bucket",
"prefix": "reports/2026/",
"glob": "*.pdf",
"profile": "financial"
}'Authentication
S3 uses standard AWS credential chain:
- Environment variables (
AWS_ACCESS_KEY_ID,AWS_SECRET_ACCESS_KEY) - Instance profile (IAM role on EC2/ECS)
- Shared credentials file
Generic webhook
For any external system, POST a file or URL reference:
# POST a URL reference
curl -X POST http://localhost:8200/connectors/webhook \
-H "Authorization: Bearer $API_KEY" \
-H "Content-Type: application/json" \
-d '{
"url": "https://internal-dms.example.com/doc/12345.docx",
"profile": "contract",
"metadata": {
"source": "my-dms",
"doc_id": "12345"
}
}'Incremental processing
All connectors benefit from incremental processing. When a connector sync re-encounters unchanged documents, they are skipped entirely — zero LLM cost.
| Connector | Without incremental | With incremental |
|---|---|---|
| SharePoint sync | Re-processes all docs | Only new/modified docs |
| Confluence sync | Re-processes all pages | Only updated pages |
| S3 sync | Re-processes all objects | Only new objects |
| Webhook retry | Full extraction | Instant cached response |
License tier requirements
| Feature | Beta | Pro | Enterprise |
|---|---|---|---|
| S3 connector | ✅ | ✅ | ✅ |
| Webhook | ✅ | ✅ | ✅ |
| SharePoint | ❌ | ✅ | ✅ |
| Confluence | ❌ | ✅ | ✅ |
Beta-tier licenses include S3 and webhook connectors. SharePoint and Confluence require Pro or Enterprise. See pricing →