SFTP (SSH File Transfer Protocol) is a secure file transfer protocol that provides encrypted data transfer over SSH connections. It’s commonly used for secure file exchange between systems, allowing businesses to safely transfer data files while maintaining data integrity and confidentiality.
Once you’re done with the step 0, go to the Sources tab and click on the “Add source” button located on the top right of your screen. Then, select the SFTP option from the list of connectors.
Click Next and you’ll be prompted to add your access.
Hostname: The host for accessing your SFTP server.
Port: The port for accessing your SFTP server.
Username: The username to access your SFTP server.
Password: The password to access your SFTP server. Use either password or private key
Private key: The private key for accessing your SFTP server. Use either password or private key
SFTP folder path: SFTP folder path where files are located
Describe your data source for easy identification within your organization. You can inform things like what data it brings, to which team it belongs, etc.
To define your Trigger, consider how often you want data to be extracted from this source. This decision usually depends on how frequently you need the new table data updated (every day, once a week, or only at specific times).
Click Done to finalize the setup. Once completed, you’ll receive confirmation that your new source is set up!
You can view your new source on the Sources page. Now, for you to be able to see it on your Catalog, you have to wait for the pipeline to run. You can now monitor it on the Sources page to see its execution and completion. If needed, manually trigger the pipeline by clicking on the refresh icon. Once executed, your new table will appear in the Catalog section.
If you encounter any issues, reach out to us via Slack, and we’ll gladly assist you!