Skip to main content
Question

Auto Integrate file with datamigration JOB

  • November 4, 2024
  • 12 replies
  • 107 views

Forum|alt.badge.img+10

My need is to read a file from an FTP folder.

The file has always he same prefix.

When a new file is detected in the folder i kneed to initaited a data migration job automaticly without schedulming the datamigration job every X minutes

Is that possible please? if so, may i have some guidance?

 

Thank’s in adavance

12 replies

Forum|alt.badge.img+10
  • Author
  • Hero (Customer)
  • 122 replies
  • November 4, 2024

@dsj i looked at Import Media Files with IFS Connect and tried to adapt it but i can’t figure out how attache a datamigration job to a reader.

 

Any help would be apretiated

 


dsj
Ultimate Hero (Partner)
Forum|alt.badge.img+22
  • Ultimate Hero (Partner)
  • 905 replies
  • November 4, 2024

Hi @IFSRUNINNOVAL

 

Have you been able to read the file via FTP and run the migration job successfully as a scheduled job and need to automate it instead of the scheduled task or need help with the complete process?

 

Which version of IFS are you in?


Forum|alt.badge.img+10
  • Author
  • Hero (Customer)
  • 122 replies
  • November 4, 2024

i’m able to read a file with the onServer option in the datamigration job and was wondering  if it is possible to auto start the datamigration job when the file is detected

 

I’m using IFS 23.1.13


Forum|alt.badge.img+10
  • Author
  • Hero (Customer)
  • 122 replies
  • November 11, 2024

Our need is to integrate a file that have a fix prefix in the file name like XXX_[sysdate]

IFS autodetec the file and load the migration job with that file.

Currently we are not able to indicate a dynamic filename to a datamigration job.

Is that possible? if so, way we have some directions on how to please?


Forum|alt.badge.img+21
  • Superhero (Employee)
  • 500 replies
  • November 11, 2024

No, that is not possible. To auto detect a file you need to use for example the SFTP-reader in IFS Connect


Forum|alt.badge.img+10
  • Author
  • Hero (Customer)
  • 122 replies
  • November 11, 2024

Thank you @Tomas Ruderfelt and @dsj 

I’m not familiar with ifs connect that’s why i’m looking into a datamigration job

is it possible to launch threw ifs connect a datamigraiton job?

The idea is the following : 

  1. SFTP reader to detect file, 
  2. Routing rule to change the file name, to the name known by the datamigration job
  3. launch the datamigration job

If it is not possible, could you route me for some documentation on how to use IFS connect to populate a custom entity please?

 

Thank’s in advance


Forum|alt.badge.img+21
  • Superhero (Employee)
  • 500 replies
  • November 11, 2024

To use IFS Connect you need a Rest API or pre built STD integration to call. Migration jobs are not possible since they are not intended to use for integration.

Can you describe what you want to create in IFS so we can see if there is a STD integration for it?

You could also instead call rest API’s from the outside if you have some kind of middleware/integration platform in between that can read the file.


Forum|alt.badge.img+10
  • Author
  • Hero (Customer)
  • 122 replies
  • November 11, 2024

From an external application we import data to be able to create customerOrders, and service contract for exemple

Those data are transformed via a datamigration job then imported in a dedicated custom entity (we do have a projection to this entity so we do have a rest api)

Some transofmration are related to the form of the data and others are used to feteched correspondante data from ifs base on the file column value.

When our custom entity is populated, and external flow read the data using rest api, then create customer orders or other object based on multiple specific rules then populate the entity with the status.

 

If we can replace all of that with ifs connect, i’m open to all documentation

We are using 23R1 and migrating to 25 next summer at the most

 

 


Forum|alt.badge.img+21
  • Superhero (Employee)
  • 500 replies
  • November 12, 2024

I think you have two options. Either you have something outside of IFS that transforms the data into a JSON format so you can directly insert the data into the custom entity from an application message or you need to do a customization for it which processes the file from the application message and transforms, then you can’t use a custom entity, instead a customized entity is needed to not mix configuration and customization.

I would not recommend to build a future proof automatic solution on Data Migration. Unless it is an interim solution and you manually import the files instead of having it automatic.


Forum|alt.badge.img+10
  • Author
  • Hero (Customer)
  • 122 replies
  • November 12, 2024

thank’s for the insight, 

What is the standard intended use of a datamigration job in IFS please?

 

Also, for language barrier, could you explain the difference betwwen custom entity and customized entity please?

Custom entity : is a LU created by the user?

Customized entity : is a standard entity which user has added custom attribut?


Forum|alt.badge.img+21
  • Superhero (Employee)
  • 500 replies
  • November 12, 2024

Data Migration is more for done for when you occasionally want to load data into the system. Like before go live or if you need to create lots of basic data if your business changes etc.

I know that many customer are using this for integrations also but as you see it has limitations regarding automation for example that is there because it is not designed for it.

 

“Custom entity : is a LU created by the user?”

Yes, it is a new LU created as a configuration from the application.

 

“Customized entity : is a standard entity which user has added custom attribut?”

It is when you create a new LU by coding, instead of configuration.


Forum|alt.badge.img+10
  • Author
  • Hero (Customer)
  • 122 replies
  • November 13, 2024

@Tomas Ruderfelt  thank you. very helpful

Where can i find documentation on how to do application message with ifs connect please?

 

Regards