Enablement for creating extensions using Apache NiFi templates

overview this guide provides end to end guidance for creating extensions using apache nifi–based templates the goal is to serve as a central reference page for extension developers, cloud practice teams, architects, consultants, and data engineers who need to build, configure, deploy, and manage extensions using the extensions framework the guide consolidates onboarding information, apache nifi fundamentals, access requirements, development workflows, sample templates, deployment guidance, and learning resources intended audience this guide is intended for extension developers cloud practice teams data engineers solution architects consultants new team members onboarding to integrations the guide assumes basic familiarity with , , containerized applications, and extension development concepts what is apache nifi? apache nifi is an open source, low code/no code data flow management framework that enables the creation of data integration pipelines through a visual drag and drop interface it supports real time data ingestion batch processing data transformation data routing security and governance controls monitoring and observability integration with multiple systems and cloud environments in kyndryl , apache nifi is a core component of the extensions framework the apache nifi extension template enables workflows to integrate with nifi and use its data ingestion, streaming, transformation, and routing capabilities across services solution architecture the extension enablement approach does not focus on developing apache nifi itself instead, it enables teams to build extensions by using preconfigured apache nifi templates provided through the extensions framework the solution consists of apache nifi development environment extension framework nifi base templates producer and consumer templates extension packaging framework kubernetes deployment environment catalog and extension management services developers build workflows visually in apache nifi and package those workflows as deployable kyndryl bridge extensions core concepts of apache nifi apache nifi is based on the principles of flow based programming (fbp) its design focuses on moving, transforming, and managing data through configurable data flows understanding these core concepts helps when creating and managing nifi extensions and data pipelines the following table describe the key apache nifi concepts and how they relate to fbp nifi term fbp term description flowfile information packet a flowfile represents a data object that moves through a nifi dataflow each flowfile contains a set of key value pair attributes and associated content, which can consist of zero or more bytes flowfile processor black box performs ingestion, routing, transformation, or delivery tasks connection bounded buffer queues data between processors flow controller scheduler process group subnet groups related workflow components