Configuring QProf as a Source
In the Sources tab, click on the “Add source” button located on the top right of your screen. Then, select the QProf option from the list of connectors. Click Next and you’ll be prompted to add your access.1. Add account access
The following configurations are available:- OData URL: Your QProf OData Standard service URL, in the form
https://<client>-odata-standard.qprof.com.br(no trailing path). Replace<client>with your QProf environment. - Access Token: The bearer access token for your QProf OData API. Request it from QProf support for your environment.
- Start Date: (optional) The earliest
DATA_ATUALIZACAO(last-updated timestamp) from which records will be synced for incremental streams. Streams that don’t expose that column are always fully synced. - Page Size: (optional, default 1000) How many rows Nekt requests per page. Lower it if very large tables time out; raise it to reduce the number of requests.
2. Select streams
Choose which data streams you want to sync. QProf exposes a large catalog of tables (see Streams and Fields below), so for faster extractions select only the streams relevant to your analysis. You can select entire groups of streams or pick specific ones.Tip: The stream can be found more easily by typing its name.Select the streams and click Next.
3. Configure data streams
Customize how you want your data to appear in your catalog. Select the desired layer where the data will be placed, a folder to organize it inside the layer, a name for each table (which will effectively contain the fetched data) and the type of sync.- Layer: choose between the existing layers on your catalog. This is where you will find your new extracted tables as the extraction runs successfully.
- Folder: a folder can be created inside the selected layer to group all tables being created from this new data source.
- Table name: we suggest a name, but feel free to customize it. You have the option to add a prefix to all tables at once and make this process faster!
- Sync Type: you can choose between INCREMENTAL and FULL_TABLE.
- Incremental: every time the extraction happens, we’ll get only the new data, based on each record’s
DATA_ATUALIZACAOtimestamp. - Full table: every time the extraction happens, we’ll get the current state of the data. Streams without a
DATA_ATUALIZACAOcolumn only support full table.
- Incremental: every time the extraction happens, we’ll get only the new data, based on each record’s
4. Configure data source
Describe your data source for easy identification within your organization, not exceeding 140 characters. To define your Trigger, consider how often you want data to be extracted from this source. This decision usually depends on how frequently you need the new table data updated (every day, once a week, or only at specific times). Optionally, you can define some additional settings:- Configure Delta Log Retention and determine for how long we should store old states of this table as it gets updated. Read more about this resource here.
- Determine when to execute an Additional Full Sync. This will complement the incremental data extractions, ensuring that your data is completely synchronized with your source every once in a while.
5. Check your new source
You can view your new source on the Sources page. If needed, manually trigger the source extraction by clicking on the arrow button. Once executed, your data will appear in your Catalog.Streams and Fields
QProf’s connector is metadata-driven: the exact set of streams and their columns is read directly from your QProf environment’s OData service, so the tables you see reflect your own QProf instance. Each stream maps one-to-one to a QProf OData entity, its slug is the entity name shown below, and its columns and primary keys come straight from the service metadata. Streams that expose aDATA_ATUALIZACAO (last-updated) column support incremental sync; the rest are full table only.
Available streams
Streams are grouped below by QProf functional area.Operations & trade (20 streams)
Operations & trade (20 streams)
Factoring/discount operations (borderôs), advances (fomento), CCB/NP boletas, additives, and the filters and import files behind them.
Titles & collection (43 streams)
Titles & collection (43 streams)
Receivable titles and everything around them: baixas, occurrences, PDD provisioning, agreements (acordos), debt confessions, remittance/return files, invoices and custodian positions.
Treasury (12 streams)
Treasury (12 streams)
Cash flow, cash books (caixa), accounts payable, payment movements, commissions on titles and purchase quotes.
Investment fund (12 streams)
Investment fund (12 streams)
FIDC cotistas (fund holders), fund movements, share series (séries de cota), contributions/withdrawals and synthetic PDD positions.
Serasa credit data (17 streams)
Serasa credit data (17 streams)
Serasa Concentre/consulta results: payment history, protests, pending debts (Pefin/Refin), corporate control and related credit-bureau records.
Registration & reference (130 streams)
Registration & reference (130 streams)
Master and reference data: people (cedentes, sacados, representatives), companies/branches, banks and agencies, chart of accounts, guarantees, tariffs, commissions, users, CNAE tables and more.
Access control (4 streams)
Access control (4 streams)
Application access records: users’ access, resources and access periods.
System (2 streams)
System (2 streams)
QProf internal utility entities (constants and the error log).