主頁 > 知識庫 > mysql in語句子查詢效率慢的優(yōu)化技巧示例

mysql in語句子查詢效率慢的優(yōu)化技巧示例

熱門標(biāo)簽:好搜地圖標(biāo)注 怎么申請400電話申請 龍圖酒吧地圖標(biāo)注 地圖標(biāo)注圖標(biāo)素材入駐 百度地圖標(biāo)注地方備注 電銷機(jī)器人價(jià)格多少錢一臺 怎么辦理400電話呢 400電話申請什么好 電話機(jī)器人免費(fèi)嗎

表結(jié)構(gòu)如下,文章只有690篇。

文章表article(id,title,content)
標(biāo)簽表tag(tid,tag_name)
標(biāo)簽文章中間表article_tag(id,tag_id,article_id)

其中有個(gè)標(biāo)簽的tid是135,查詢標(biāo)簽tid是135的文章列表。

690篇文章,用以下的語句查詢,奇慢:

select id,title from article where id in(
select article_id from article_tag where tag_id=135
)

其中這條速度很快:

select article_id from article_tag where tag_id=135

查詢結(jié)果是五篇文章,id為428,429,430,431,432

用下面sql來查文章也很快:

select id,title from article where id in(
428,429,430,431,432
)

解決方法:

select id,title from article where id in(
select article_id from (select article_id from article_tag where tag_id=135) as tbt
)

其它解決方法:(舉例)

mysql> select * from abc_number_prop where number_id in (select number_id from abc_number_phone where phone = '82306839');

為了節(jié)省篇幅,省略了輸出內(nèi)容,下同。

67 rows in set (12.00 sec)

只有67行數(shù)據(jù)返回,卻花了12秒,而系統(tǒng)中可能同時(shí)會有很多這樣的查詢,系統(tǒng)肯定扛不住。用desc看一下(注:explain也可)

mysql> desc select * from abc_number_prop where number_id in (select number_id from abc_number_phone where phone = '82306839');
+----+--------------------+------------------+--------+-----------------+-------+---------+------------+---------+--------------------------+
| id | select_type | table | type | possible_keys | key | key_len | ref | rows | Extra |
+----+--------------------+------------------+--------+-----------------+-------+---------+------------+---------+--------------------------+
| 1 | PRIMARY | abc_number_prop | ALL | NULL | NULL | NULL | NULL | 2679838 | Using where |
| 2 | DEPENDENT SUBQUERY | abc_number_phone | eq_ref | phone,number_id | phone | 70 | const,func | 1 | Using where; Using index |
+----+--------------------+------------------+--------+-----------------+-------+---------+------------+---------+--------------------------+
2 rows in set (0.00 sec)

可以看出,在執(zhí)行此查詢時(shí)會掃描兩百多萬行,難道是沒有創(chuàng)建索引嗎,看一下

mysql>show index from abc_number_phone;
+------------------+------------+-------------+--------------+-----------------+-----------+-------------+----------+--------+------+------------+---------+---------------+
| Table | Non_unique | Key_name | Seq_in_index | Column_name | Collation | Cardinality | Sub_part | Packed | Null | Index_type | Comment | Index_comment |
+------------------+------------+-------------+--------------+-----------------+-----------+-------------+----------+--------+------+------------+---------+---------------+
| abc_number_phone | 0 | PRIMARY | 1 | number_phone_id | A | 36879 | NULL | NULL | | BTREE | | |
| abc_number_phone | 0 | phone | 1 | phone | A | 36879 | NULL | NULL | | BTREE | | |
| abc_number_phone | 0 | phone | 2 | number_id | A | 36879 | NULL | NULL | | BTREE | | |
| abc_number_phone | 1 | number_id | 1 | number_id | A | 36879 | NULL | NULL | | BTREE | | |
| abc_number_phone | 1 | created_by | 1 | created_by | A | 36879 | NULL | NULL | | BTREE | | |
| abc_number_phone | 1 | modified_by | 1 | modified_by | A | 36879 | NULL | NULL | YES | BTREE | | |
+------------------+------------+-------------+--------------+-----------------+-----------+-------------+----------+--------+------+------------+---------+---------------+
6 rows in set (0.06 sec)
mysql>show index from abc_number_prop;
+-----------------+------------+-------------+--------------+----------------+-----------+-------------+----------+--------+------+------------+---------+---------------+
| Table | Non_unique | Key_name | Seq_in_index | Column_name | Collation | Cardinality | Sub_part | Packed | Null | Index_type | Comment | Index_comment |
+-----------------+------------+-------------+--------------+----------------+-----------+-------------+----------+--------+------+------------+---------+---------------+
| abc_number_prop | 0 | PRIMARY | 1 | number_prop_id | A | 311268 | NULL | NULL | | BTREE | | |
| abc_number_prop | 1 | number_id | 1 | number_id | A | 311268 | NULL | NULL | | BTREE | | |
| abc_number_prop | 1 | created_by | 1 | created_by | A | 311268 | NULL | NULL | | BTREE | | |
| abc_number_prop | 1 | modified_by | 1 | modified_by | A | 311268 | NULL | NULL | YES | BTREE | | |
+-----------------+------------+-------------+--------------+----------------+-----------+-------------+----------+--------+------+------------+---------+---------------+
4 rows in set (0.15 sec)

從上面的輸出可以看出,這兩張表在number_id字段上創(chuàng)建了索引的。
看看子查詢本身有沒有問題。

mysql> desc select number_id from abc_number_phone where phone = '82306839';
+----+-------------+------------------+------+---------------+-------+---------+-------+------+--------------------------+
| id | select_type | table | type | possible_keys | key | key_len | ref | rows | Extra |
+----+-------------+------------------+------+---------------+-------+---------+-------+------+--------------------------+
| 1 | SIMPLE | abc_number_phone | ref | phone | phone | 66 | const | 6 | Using where; Using index |
+----+-------------+------------------+------+---------------+-------+---------+-------+------+--------------------------+
1 row in set (0.00 sec)

沒有問題,只需要掃描幾行數(shù)據(jù),索引起作用了。

查詢出來看看:

mysql> select number_id from abc_number_phone where phone = '82306839';
+-----------+
| number_id |
+-----------+
| 8585 |
| 10720 |
| 148644 |
| 151307 |
| 170691 |
| 221897 |
+-----------+
6 rows in set (0.00 sec)

直接把子查詢得到的數(shù)據(jù)放到上面的查詢中

mysql> select * from abc_number_prop where number_id in (8585, 10720, 148644, 151307, 170691, 221897);
67 rows in set (0.03 sec)

速度也快,看來MySQL在處理子查詢的時(shí)候是不夠好。我在MySQL 5.1.42 和 MySQL 5.5.19 都進(jìn)行了嘗試,都有這個(gè)問題。

搜索了一下網(wǎng)絡(luò),發(fā)現(xiàn)很多人都遇到過這個(gè)問題:

參考資料1:MySQL優(yōu)化之使用連接(join)代替子查詢

參考資料2:MYSQL子查詢和嵌套查詢優(yōu)化實(shí)例解析

根據(jù)網(wǎng)上這些資料的建議,改用join來試試。
修改前:

select * from abc_number_prop where number_id in (select number_id from abc_number_phone where phone = '82306839');

修改后:

select a.* from abc_number_prop a inner join abc_number_phone b on a.number_id = b.number_id where phone = '82306839';
mysql> select a.* from abc_number_prop a inner join abc_number_phone b on a.number_id = b.number_id where phone = '82306839';
67 rows in set (0.00 sec)

效果不錯(cuò),查詢所用時(shí)間幾乎為0。看一下MySQL是怎么執(zhí)行這個(gè)查詢的

mysql>desc select a.* from abc_number_prop a inner join abc_number_phone b on a.number_id = b.number_id where phone = '82306839';
+----+-------------+-------+------+-----------------+-----------+---------+-----------------+------+--------------------------+
| id | select_type | table | type | possible_keys | key | key_len | ref | rows | Extra |
+----+-------------+-------+------+-----------------+-----------+---------+-----------------+------+--------------------------+
| 1 | SIMPLE | b | ref | phone,number_id | phone | 66 | const | 6 | Using where; Using index |
| 1 | SIMPLE | a | ref | number_id | number_id | 4 | eap.b.number_id | 3 | |
+----+-------------+-------+------+-----------------+-----------+---------+-----------------+------+--------------------------+
2 rows in set (0.00 sec)

小結(jié):當(dāng)子查詢速度慢時(shí),可用JOIN來改寫一下該查詢來進(jìn)行優(yōu)化。

網(wǎng)上也有文章說,使用JOIN語句的查詢不一定總比使用子查詢的語句快。

mysql手冊也提到過,具體的原文在mysql文檔的這個(gè)章節(jié):
I.3. Restrictions on Subqueries
13.2.8. Subquery Syntax

摘抄:

1)關(guān)于使用IN的子查詢:

Subquery optimization for IN is not as effective as for the = operator or for IN(value_list) constructs.

A typical case for poor IN subquery performance is when the subquery returns a small number of rows but the outer query returns a large number of rows to be compared to the subquery result.

The problem is that, for a statement that uses an IN subquery, the optimizer rewrites it as a correlated subquery. Consider the following statement that uses an uncorrelated subquery:

SELECT ... FROM t1 WHERE t1.a IN (SELECT b FROM t2);

The optimizer rewrites the statement to a correlated subquery:

SELECT ... FROM t1 WHERE EXISTS (SELECT 1 FROM t2 WHERE t2.b = t1.a);

If the inner and outer queries return M and N rows, respectively, the execution time becomes on the order of O(M×N), rather than O(M+N) as it would be for an uncorrelated subquery.

An implication is that an IN subquery can be much slower than a query written using an IN(value_list) construct that lists the same values that the subquery would return.

2)關(guān)于把子查詢轉(zhuǎn)換成join的:

The optimizer is more mature for joins than for subqueries, so in many cases a statement that uses a subquery can be executed more efficiently if you rewrite it as a join.

An exception occurs for the case where an IN subquery can be rewritten as a SELECT DISTINCT join. Example:

SELECT col FROM t1 WHERE id_col IN (SELECT id_col2 FROM t2 WHERE condition);

That statement can be rewritten as follows:

SELECT DISTINCT col FROM t1, t2 WHERE t1.id_col = t2.id_col AND condition;

But in this case, the join requires an extra DISTINCT operation and is not more efficient than the subquery

總結(jié)

以上就是本文關(guān)于mysql in語句子查詢效率慢的優(yōu)化技巧示例的全部內(nèi)容,感興趣的朋友而可以參閱:淺談mysql的子查詢聯(lián)合與in的效率、企業(yè)生產(chǎn)MySQL優(yōu)化介紹等,有什么問題可以留言,歡迎大家一起交流參考。

希望本文所述對大家有所幫助。

您可能感興趣的文章:
  • MySQL里面的子查詢實(shí)例
  • 解決MySQL中IN子查詢會導(dǎo)致無法使用索引問題
  • 詳細(xì)講述MySQL中的子查詢操作
  • 詳解MySQL子查詢(嵌套查詢)、聯(lián)結(jié)表、組合查詢
  • MySQL優(yōu)化之使用連接(join)代替子查詢
  • Mysql子查詢IN中使用LIMIT應(yīng)用示例
  • MYSQL子查詢和嵌套查詢優(yōu)化實(shí)例解析
  • mysql實(shí)現(xiàn)多表關(guān)聯(lián)統(tǒng)計(jì)(子查詢統(tǒng)計(jì))示例
  • MySQL筆記之子查詢使用介紹
  • MySQL子查詢中order by不生效問題的解決方法

標(biāo)簽:防疫工作 廣西 汕尾 撫順 溫州 固原 內(nèi)江 浙江

巨人網(wǎng)絡(luò)通訊聲明:本文標(biāo)題《mysql in語句子查詢效率慢的優(yōu)化技巧示例》,本文關(guān)鍵詞  mysql,語,句子,查詢,效率,;如發(fā)現(xiàn)本文內(nèi)容存在版權(quán)問題,煩請?zhí)峁┫嚓P(guān)信息告之我們,我們將及時(shí)溝通與處理。本站內(nèi)容系統(tǒng)采集于網(wǎng)絡(luò),涉及言論、版權(quán)與本站無關(guān)。
  • 相關(guān)文章
  • 下面列出與本文章《mysql in語句子查詢效率慢的優(yōu)化技巧示例》相關(guān)的同類信息!
  • 本頁收集關(guān)于mysql in語句子查詢效率慢的優(yōu)化技巧示例的相關(guān)信息資訊供網(wǎng)民參考!
  • 推薦文章