Extract required data from huge DB about 40 GB: Taking too much time to filter data and get required results

	All requests	>	Extract required data from huge DB about 40 GB	>	Request new recommendation	>	Featured requests	>	No recommendations

Extract required data from huge DB about 40 GB

Edit

by Siva Kumar - 7 months ago (2015-06-19) fast database retrieval

Taking too much time to filter data and get required results

+1

I am working in system which connects to multiple channels like booking.com, hrs.com, centralR, etc. nearly about to 50 channels. The working system takes input data from hotels and send them to these channels for online reservation. There is page which shows the each update sent to channel received from hotels base for selection of hotel, room type, etc.. We maintain the last 3 months data which is nearly about 40 GB. This DB is well designed and indexed. Can any one please suggest a package which can improve retrieving from this data.

• 1 Clarification request

• 1. by Manuel Lemos - 7 months ago (2015-06-19) Reply

  I suspect there is not PHP class for that problem, if this is a matter of speed of queries to the database.

  I think you need to figure which database queries are taking too long.

  If you are using MySQL, then you can use the EXPLAIN command followed by the slow query and it will tell you what clauses are using indexes or not.

  Try to do that for your slowest query and reply here showing the query and the output of the EXPLAIN command, so we can advise.

• 2. by Dave Smith - 7 months ago (2015-06-19) in reply to comment 1 by Manuel Lemos Comment

  I have to agree, that it is most likely a poorly designed query, assuming that the database is truly well designed and indexed.

  Another possibility is scalability issues, how much traffic is your site getting?

Ask clarification

1 Recommendation

QDataObject: Access MySQL query results as objects

+1

by Manuel Lemos 11100 - 7 months ago (2015-06-20) Comment Looking again there is this MySQL database access wrapper that logs slow queries. This may not optimize your application automatically but it may help detecting which queries are taking too long and probably need to have the be rethought or added adequate indexes.