Draft:KSML (Apache Kafka)
Submission declined on 25 October 2021 by Nearlyevil665 (talk).
Where to get help
How to improve a draft
You can also browse Wikipedia:Featured articles and Wikipedia:Good articles to find examples of Wikipedia's best writing on topics similar to your proposed article. Improving your odds of a speedy review To improve your odds of a faster review, tag your draft with relevant WikiProject tags using the button below. This will let reviewers know a new draft has been submitted in their area of interest. For instance, if you wrote about a female astronomer, you would want to add the Biography, Astronomy, and Women scientists tags. Editor resources
|
KSML is an expression language and accompanying interpreter that allows users to specify Kafka Streams topologies as YAML. It was open sources by Axual in May 2021 under Apache License 2 with code published on GitHub.
The idea
[edit]The general idea of KSML is to express stream processing operations as a series of operations applied to a Kafka topic. The simplest example of a copying application is expressed as follows:
pipelines: main: from: some_topic to: some_other_topic
This example defines a topology that copies messages from a given source topic to a target topic. Custom functions can be added to the YAML specification as Python functions. For more information, see the KSML documentation.
Implementation
[edit]Under the hood, KSML delivers an interpreter that reads in the YAML definitions and maps them onto a Kafka Streams topology. This topology is then passed onto the Kafka Streams framework itself to be executed continuously.
Distribution
[edit]KSML is distributed as source code and as Docker images for plain Kafka and Axual Platform / Cloud.
- in-depth (not just passing mentions about the subject)
- reliable
- secondary
- independent of the subject
Make sure you add references that meet these criteria before resubmitting. Learn about mistakes to avoid when addressing this issue. If no additional references exist, the subject is not suitable for Wikipedia.