We have a requirement where we are required to load multiple files having same schema into the one target table using single job.
we have emp1.txt,emp2.txt,emp3.txt in folder having same schema (Name,sal)
Solution:
Use a tFileList with a regular expression to get only the files whose name starts with emp. In our case file mask is emp*
GIve the Iterate connection to tFileInputDelimited
tFileInputDelimited can read them one by one by using the global variable ((String)globalMap.get("tFileList_1_CURRENT_FILEPATH")) and send the data to tmap and tDBoutput
Job screenshot:
Video Solution:https://www.youtube.com/watch?v=hTsr1-v1AAo