connectors

No menu items for this category
Collate Documentation
NiFi

NiFi

PROD
Available In
Feature List
Pipelines
Usage
Lineage
Pipeline Status
Owners
Tags

In this section, we provide guides and references to use the NiFi connector.

Configure and schedule NiFi metadata workflows from the OpenMetadata UI:

OpenMetadata supports 2 types of connection for the NiFi connector:

  • basic authentication: use username/password to authenticate to NiFi.
  • client certificate authentication: use CA, client certificate and client key files to authenticate.

The user should be able to send request to the NiFi API and access the Resources endpoint.

Click Settings in the side navigation bar and then Services.

The first step is to ingest the metadata from your sources. To do that, you first need to create a Service connection first.

This Service will be the bridge between OpenMetadata and your source system.

Once a Service is created, it can be used to configure your ingestion workflows.

Visit Services Page

Select your Service Type and Add a New Service

Click on Add New Service to start the Service creation.

Create a new Service

Add a new Service from the Services page

Select Nifi as the Service type and click Next.

Select Service

Select your Service from the list

Provide a name and description for your Service.

OpenMetadata uniquely identifies Services by their Service Name. Provide a name that distinguishes your deployment from other Services, including the other Nifi Services that you might be ingesting metadata from.

Note that when the name is set, it cannot be changed.

Add New Service

Provide a Name and description for your Service

In this step, we will configure the connection settings required for Nifi.

Please follow the instructions below to properly configure the Service to read from your sources. You will also find helper documentation on the right-hand side panel in the UI.

Configure Service connection

Configure the Service connection by filling the form

When using a Hybrid Ingestion Runner, any sensitive credential fieldsโ€”such as passwords, API keys, or private keysโ€”must reference secrets using the following format: