Note: my question is incorporated in the last paragraph.

I've multiple causes of files that will get placed right into a database (refer to it as process/database A). These files retain the same kind of information however in different formats (i.e. different column headers, orders, quantity of posts, etc.), however when process A puts them right into a unified table, which is nice neat. I want this data from multiple sources also placed into another database (process/database B), but I am unsure what's the easiest way to do this. DB B is a component of the software we use. It's not open-source, but DB connection can be created.

Finances process A ready to go for some time. Process B is one thing a new comer to improve physical workflow in the warehouse. I believe because the information is already unified in process A, it appears in my experience which i should pull this unified data and place it into B. This can save me the repetitive work of remapping everything for process B.

My real question is, if I wish to "sync" both of these databases, what will be the optimal approach? It isn't exactly "syncing," I guess, since the two tables (only have to reference one table on each DB) have different posts. I see these approaches..

  1. Look into the entire DB's and pull from DB A to place to DB B for brand new data. However, DB B has over 50K rows. DB A is a lot more compact and growing gradually.

  2. Possess the user input to start dating ? by which to search for new data rows to place from One place to another.

  3. Look into the latest date (data rows are dated) in DB B, and place accordingly.

Do everyone have inputs? I am much less acquainted with MySQL processing speed, so I am unsure if approach 1 is a great option. I am also unsure what some conventions (if any) are for these kinds of tasks. I imagine it is not a too-uncommon factor to complete. But (1) appears to become a more complete method of doing things. Any comments or alternative choices are appreciated. Let me keep things in PHP as it will likely be an element on the web application. TIA!

Use mysql clustering Check it : http://en.wikipedia.org/wiki/MySQL_Cluster