I recently started my career as Data Engineer, with everyday I explore the dynamics of field and get to know something new. I want to ask if there is any dedicated website, courses or learning path(s) available online to learn this relatively new field. Note: Let me know if I have asked this question on wrong stack and guide me the correct platform to ask help on this question.

I have been trying to import CSV data about 60 MB; it contains about 400,000 rows, which should not be too much. I tried these ways to import the data: 1. MySQL Workbench - it took about two hours!!! 2. Using MySQL LOAD INFILE command - it took about 15 seconds! 3. Using Talend Open Studio - almost as long as Workbench. Why are the GUI tools working so badly? I want to use GUI-based tools, instead of writing scripts. With Talend Open Studio, is there a way to speed things up? I heard that there is possibly another Talend product that deals with Big Data, will this do it faster than Talend Open Studio? Hope someone out there knows! I know that in Hadoop using Pig, I can get the the CSV from HDFS into Pig memory very quickly.

I am using Talend to backup MS SQL to MySQL Server. Everything goes well, I have a connection, data flows from one db to the other... however I cannot correctly copy diacritic signs. On MS SQL I have Polish_CI_AS and on MySQL I have Latin2 general_ci. When I tried to copy data from MS SQL to an Excel file, everything is in place. I concluded that problem lies in MySQL. Have you encountered this issue before?