Demyst Connectors: feature list

📘
Overview
This guide documents the capabilities enabled when creating Connectors in the Demyst platform. All Connectors created are production-worthy integrations that includes all the features enterprises expect of a world class data management platform.

Interoperability

Standardized REST Endpoint: Uniform REST API across Connectors for multi-platform compatibility.
Share Configuration: Export data to a landing zone in a standardized format, incorporating ETL jobs, encryption, encoding, and more.
Data Scheduling: Configure data delivery schedule.
Data Orchestration: Assemble and orchestrate multiple Connectors to a destination.
Realtime Data Replication: Populate data lakes or warehouses from realtime transactions.

Access Control

Security Management: Role-based access control, IP whitelisting, and API key management for secure data access.
Rate Limiting: Enables adherence to contracted limitations on rates of calling upstream APIs.
Organization Management: Configure settings like SSO, MFA, user access controls, and IP whitelisting to meet infosec and regulatory requirements.

Observability

Connector Performance and Quality: Insightful metrics such as latency, throughput, and error rates measuring Connector health.
Data Movement Logging: Detailed transaction and ELT job logs for monitoring, alerting, and auditing.
Monitoring and Alerting: Timely responses to incidents with custom alert rules and data monitoring.
Error Management: Standardized error mapping to simplify debugging and reduce integration cycle time.
Connector Versioning: Version control for your Connectors to manage ongoing updates and integrations.
Data Scheduling: Monitor recurring enrichments and data deliveries according to predefined schedules and error handling mechanisms.
Data Lineage and Provenance: Metadata payloads documenting journey of data, providing a complete view on data lineage and provenance.

Discoverability

Automated Schema Detection: Attributes and their types are automatically identified in their data dictionary, supporting in data discovery.
Entity Resolution: Match internal data to specific external sources for enrichment, leveraging schema analysis and matching rules.
Data API Schema Customization: Customizable output formats and data structures.

Usability

Error Management: Standardized errors speed up troubleshooting and incident response time.
Data Composition: Assemble multiple sources into a single Connector with standardized interface.
Data Harmonization: Harmonize data across multiple sources in a technical configuration.
Transactional Cache: Configure transactional cache for a Connector.
Validations: Configure data validations to be applied to a Connector when data is received.
Transformations: Set up custom transformations to a Connector to achieve some specific outcomes.