Me and my colleagues are part of a project to ingest data from IFS to google cloud platform, where we collect and curate data from ifs and other systems in order to gain insights using PowerBI.
We would like to access objversion each table in the client API, so that we can load data hourly both incrementally and idempotently.
But this field is not exposed in the API.
One option presented to us was to add a custom field from the objversion, but this poses another problem, because custom fields are added in the CFT tabal, which mean they are not part of any index on the table. This means that each request to a table performs a full table scan, which we do not want for two reasons:
1. It is slow and sometimes times out
2. It is too much processing on the database.
Another option would be to load the entire table each hour, but that won't cut it for obvious reasons.
In our estimation, exposing the objversion as a field in the client API would solve our problem with minimal effort involved. We also think this would benefit a lot of your customers.
To the IFS team: Can you add this, expose this field in the API? If not, why not?
To the community: How have you solved this issue?
Question
Incremental load with objversionfrom oData API
Reply
Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.