How you can manage failed pipelines on Nekt.
Data pipelines can sometimes fail. Although it is inherent to working with data, we work hard to avoid that and help you overcome the situation.
Nekt allows you to activate alerts for specific pipelines and get notified on your email if they fail. This helps you to quickly take action and get your data pipeline back as soon as possible.
Go to the details page of the source, transformation, destination, or visualization you want to monitor, then enable alerts using the toggle button in the upper right corner.
Alerts are configured individually! Each user must activate alerts for their relevant pipelines, and notifications will be sent to the registered email address (the same one you use to log into the Nekt platform). You can not activate alerts for someone else in your workspace.
Here are some reasons why your pipeline might be failing and how you can deal with it.
In case there’s something wrong with the connector (for sources and destinations), the transformation code or any credentials used to access external tools, a fix or update will be needed. The easiest way to understand the error is checking the run logs.
There’s usually a message saying what happened and what needs to be done. In case there’s nothing really useful logged, please get in touch with us and we’ll investigate it further.
Data pipelines can sometimes fail due to system instabilities or temporary issues. Nekt allows you to configure retry parameters for each Source, Transformation, or Destination, ensuring reliable pipeline execution without unnecessary resource usage.
These parameters can be managed in the settings tab of each Source, Transformation and Destination, providing flexibility in how you handle pipeline stability and recovery.