NiFi: An Architecture Overview

The core concepts of NiFi

  1. What is FlowFile
  • Lends well to visual creation and management of directed graphs of processors
  • Is inherently asynchronous which allows for very high throughput and natural buffering even as processing and flow rates fluctuate
  • Provides a highly concurrent model without a developer having to worry about the typical complexities of concurrency
  • Promotes the development of cohesive and loosely coupled components which can then be reused in other contexts and promotes testable units
  • The resource constrained connections make critical functions such as back-pressure and pressure release very natural and intuitive
  • Error handling becomes as natural as the happy-path rather than a coarse grained catch-all
  • The points at which data enters and exits the system as well as how it flows through are well understood and easily tracked

NiFi Architecture

High Level Overview of Key NiFi Features

--

--

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store
Arun Singh

Arun Singh

Work as Enterprise Data Architect, Cloud Data Architect and focuses on building data architectures on cloud platforms. www.linkedin.com/in/arun-k-singh-3221372