Apache Doris offers multi-dimensional knowledge ingestion capabilities. Along with the built-in Routine Load and Flink’s assist for studying from Kafka and writing to Doris, the Doris Kafka Connector [1], as an prolonged part of the Kafka Join ecosystem, not solely helps importing Kafka knowledge into Doris but additionally depends on the huge Kafka Join ecosystem to attain the next options [2]:
Wealthy Format Assist
- Natively parses advanced codecs resembling Avro/Protobuf.
- Routinely registers and converts schemas.
- Optimizes the environment friendly processing of binary knowledge streams.
Heterogeneous Integration of A number of Knowledge Sources
- Relational databases: MySQL, Oracle, SQL Server, DB2, Informix, and so forth.
- NoSQL databases: MongoDB, Cassandra, and so forth.
- Message queue techniques: ActiveMQ, IBM MQ, RabbitMQ, and so forth.
- Cloud knowledge warehouses: Snowflake, Google BigQuery, Amazon Redshift, and so forth.
