Так с инструментами вроде все нормально, пробегались по ним несколько раз да и ТП Битрикс сказала что со стороны сайта все отлично работает и нет страниц которые могли бы создавать нагрузку. По всем инструментам в битриксе пробегались и перепроверяли. Да и композит включен у нас.
Обмен с 1С не используется и импорт экспорт тоже не задействован, задач по крону так же нет
Заметили одну особенность в логах а именно яндекс за период с 0 часов сегодняшнего дня до 10 утра 2715 посещений яндекс робота, быть может это всетаки его рук дело? робот решил проиндексировать новый товар и делает это усердно, если да то как быть с этой ситуацией. такое бывает не часто но повторений не хочется.
и второй момент в логах, ссылки по которым ходит яндекс робот (к примеру первые две)
/catalog/products/komplekt_shtory_i_pokryvalo/filter/price-from-13172-to-17753/<img%20id=
/catalog/products/komplekt_shtory_i_pokryvalo/filter/price-from-13172-to-17753/%3Cimg%20id=/
По логике яндекс пришел два раза на одну и ту же страницу по разным ссылкам, этим создавая дополнительную нагрузку, но откуда он берет эти сссылки с окончаниями
<img%20id= и %3Cimg%20id=/ а в некоторых случаях и вовсе имеет вид:
/catalog/products/polotentsa/filter/price-to-464/razmer-70_140_sm/%3Cimg%20id=/%3Cimg%20id=/%3Cimg%20id=/%3Cimg%20id=/<img%20id=
и не понятно откуда берется
%3Cimg%20id=/%3Cimg%20id=/%3Cimg%20id=/%3Cimg%20id=/<img%20id=
при поиске в коде, обнаружить это не удалось,
может кто то уже сталкивался с подобным подскажите как быть в этой ситуации
Код |
---|
Line 673: euro-postel.ru 5.255.253.122 - - [26/Mar/2015:18:42:07 +0300] "GET /catalog/products/komplekt_shtory_i_pokryvalo/filter/price-from-13172-to-17753/<img%20id= HTTP/1.0" 301 321 "-" "Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots)"
Line 674: euro-postel.ru 5.255.253.134 - - [26/Mar/2015:18:42:09 +0300] "GET /catalog/products/komplekt_shtory_i_pokryvalo/filter/price-from-13172-to-17753/%3Cimg%20id=/ HTTP/1.0" 200 20245 "-" "Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots)"
Line 675: euro-postel.ru 5.255.253.134 - - [26/Mar/2015:18:42:12 +0300] "GET /catalog/products/postelnoe_bele/kpb_mikrofibra_valteri_mf_18/ HTTP/1.0" 200 15490 "-" "Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots)"
Line 676: euro-postel.ru 5.255.253.176 - - [26/Mar/2015:18:42:15 +0300] "GET /catalog/products/cotton/filter/razmer-40_60_sm_3sht/ HTTP/1.0" 200 19119 "-" "Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots)"
Line 677: euro-postel.ru 5.255.253.134 - - [26/Mar/2015:18:42:17 +0300] "GET /catalog/products/postelnoe_belye_iz_zhakkarda/kpb_tkannyy_zhakkard_s_vyshivkoy_valteri_220_87/ HTTP/1.0" 200 15658 "-" "Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots)"
Line 678: euro-postel.ru 5.255.253.144 - - [26/Mar/2015:18:42:20 +0300] "GET /catalog/products/towels_bamboo/salfetki_bambuk_karna_organic_1_3_v3/%3Cimg%20id=/ HTTP/1.0" 404 29097 "-" "Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots)"
Line 679: euro-postel.ru 5.255.253.134 - - [26/Mar/2015:18:42:23 +0300] "GET /catalog/products/detskoe_postelnoe_bele/komplekt_postelnogo_belya_issimo_home_rally_sine_goluboy/%3Cimg%20id=/ HTTP/1.0" 404 29109 "-" "Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots)"
Line 681: euro-postel.ru 5.255.253.237 - - [26/Mar/2015:18:42:25 +0300] "GET /catalog/products/cotton_mattress_topper/namatrasnik_na_rezinkakh_issimo_home_alez_matress_protector/%3Cimg%20id=/ HTTP/1.0" 404 29113 "-" "Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots)"
Line 682: euro-postel.ru 5.255.253.134 - - [26/Mar/2015:18:42:27 +0300] "GET /catalog/products/postelnoe_belye_iz_zhakkarda/kpb_tkannyy_zhakkard_s_vyshivkoy_valteri_220_85/ HTTP/1.0" 200 15584 "-" "Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots)"
Line 686: euro-postel.ru 5.255.253.122 - - [26/Mar/2015:18:42:30 +0300] "GET /catalog/products/sateen/komplekt_postelnogo_belya_issimo_home_vira_belo_seryy/%3Cimg%20id=/ HTTP/1.0" 404 29100 "-" "Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots)"
Line 687: euro-postel.ru 5.255.253.122 - - [26/Mar/2015:18:42:32 +0300] "GET /yenisite.resizer2/js/colorpicker/ HTTP/1.0" 200 8227 "-" "Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots)"
Line 688: euro-postel.ru 5.255.253.237 - - [26/Mar/2015:18:42:34 +0300] "GET /catalog/products/towels_bamboo/nabor_bambukovykh_polotenets_premium_tyemno_zelyenyy_/ HTTP/1.0" 200 15563 "-" "Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots)"
Line 689: euro-postel.ru 5.255.253.134 - - [26/Mar/2015:18:42:37 +0300] "GET /catalog/products/prostyni_iz_bambuka/prostyn_c_velyurom_cestepe_viscon_temno_korichnevyy/ HTTP/1.0" 200 15527 "-" "Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots)"
Line 690: euro-postel.ru 5.255.253.144 - - [26/Mar/2015:18:42:40 +0300] "GET /catalog/products/shtory_i_pokryvala/pokryvalo_issimo_lesli_cover_zelenyy/ HTTP/1.0" 200 15464 "-" "Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots)"
Line 691: euro-postel.ru 5.255.253.122 - - [26/Mar/2015:18:42:43 +0300] "GET /catalog/products/postelnoe_bele/kpb_poplin_saylid_a_130/ HTTP/1.0" 200 15371 "-" "Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots)"
Line 693: euro-postel.ru 5.255.253.144 - - [26/Mar/2015:18:43:30 +0300] "GET /catalog/products/postelnoe_bele/kpb_poplin_saylid_a_131/ HTTP/1.0" 200 15432 "-" "Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots)"
Line 694: euro-postel.ru 5.255.253.176 - - [26/Mar/2015:18:43:33 +0300] "GET /catalog/products/postelnoe_bele/kpb_poplin_saylid_a_136/ HTTP/1.0" 200 15398 "-" "Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots)"
Line 695: euro-postel.ru 5.255.253.168 - - [26/Mar/2015:18:43:36 +0300] "GET /catalog/products/postelnoe_bele/kpb_poplin_saylid_a_135/ HTTP/1.0" 200 15433 "-" "Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots)"
Line 697: euro-postel.ru 5.255.253.134 - - [26/Mar/2015:18:43:39 +0300] "GET /catalog/products/postelnoe_bele/kpb_poplin_saylid_a_137/ HTTP/1.0" 200 15406 "-" "Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots)"
Line 698: euro-postel.ru 5.255.253.134 - - [26/Mar/2015:18:43:42 +0300] "GET /catalog/products/postelnoe_bele/kpb_poplin_saylid_a_138/ HTTP/1.0" 200 15432 "-" "Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots)"
Line 699: euro-postel.ru 5.255.253.168 - - [26/Mar/2015:18:43:46 +0300] "GET /catalog/products/postelnoe_bele/kpb_poplin_saylid_a_127/ HTTP/1.0" 200 15447 "-" "Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots)"
Line 700: euro-postel.ru 5.255.253.237 - - [26/Mar/2015:18:43:49 +0300] "GET /catalog/products/postelnoe_bele/kpb_poplin_saylid_a_139/ HTTP/1.0" 200 15451 "-" "Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots)"
Line 701: euro-postel.ru 5.255.253.176 - - [26/Mar/2015:18:43:51 +0300] "GET /catalog/products/postelnoe_bele/kpb_poplin_saylid_a_128/ HTTP/1.0" 200 15409 "-" "Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots)"
Line 702: euro-postel.ru 5.255.253.134 - - [26/Mar/2015:18:43:55 +0300] "GET /catalog/products/postelnoe_bele/kpb_poplin_saylid_a_160/ HTTP/1.0" 200 15405 "-" "Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots)"
Line 703: euro-postel.ru 5.255.253.144 - - [26/Mar/2015:18:43:57 +0300] "GET /catalog/products/postelnoe_bele/kpb_poplin_saylid_a_143/ HTTP/1.0" 200 15433 "-" "Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots)"
Line 704: euro-postel.ru 5.255.253.122 - - [26/Mar/2015:18:44:00 +0300] "GET /catalog/products/postelnoe_bele/kpb_poplin_saylid_a_140/ HTTP/1.0" 200 15497 "-" "Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots)"
Line 705: euro-postel.ru 5.255.253.134 - - [26/Mar/2015:18:44:03 +0300] "GET /catalog/products/postelnoe_bele/kpb_poplin_saylid_a_144/ HTTP/1.0" 200 15490 "-" "Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots)"
Line 706: euro-postel.ru 5.255.253.176 - - [26/Mar/2015:18:44:06 +0300] "GET /catalog/products/postelnoe_bele/kpb_poplin_saylid_a_142/ HTTP/1.0" 200 15438 "-" "Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots)"
Line 707: euro-postel.ru 5.255.253.237 - - [26/Mar/2015:18:44:10 +0300] "GET /catalog/products/postelnoe_bele/kpb_korolevskiy_satin_famile_rs_213/ HTTP/1.0" 200 15491 "-" "Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots)"
Line 708: euro-postel.ru 5.255.253.122 - - [26/Mar/2015:18:44:13 +0300] "GET /catalog/products/postelnoe_bele/kpb_korolevskiy_satin_famile_rs_219/ HTTP/1.0" 200 15495 "-" "Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots)"
Line 709: euro-postel.ru 5.255.253.176 - - [26/Mar/2015:18:44:16 +0300] "GET /catalog/products/postelnoe_bele/kpb_korolevskiy_satin_famile_rs_220/ HTTP/1.0" 200 15479 "-" "Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots)"
Line 711: euro-postel.ru 5.255.253.144 - - [26/Mar/2015:18:44:18 +0300] "GET /catalog/products/postelnoe_bele/kpb_korolevskiy_satin_famile_rs_218/ HTTP/1.0" 200 15443 "-" "Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots)"
Line 873: euro-postel.ru 5.255.253.122 - - [26/Mar/2015:18:52:42 +0300] "GET /catalog/products/gotovye_shtory/layma_kukhnya_dacha_portera_podkhvat_k0801_08/ HTTP/1.0" 200 15847 "-" "Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots)"
Line 874: euro-postel.ru 5.255.253.134 - - [26/Mar/2015:18:52:46 +0300] "GET /catalog/products/polotentsa/filter/price-to-464/razmer-70_140_sm/%3Cimg%20id=/%3Cimg%20id=/%3Cimg%20id=/%3Cimg%20id=/<img%20id= HTTP/1.0" 301 360 "-" "Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots)"
Line 875: euro-postel.ru 5.255.253.168 - - [26/Mar/2015:18:52:48 +0300] "GET /catalog/products/polotentsa/filter/price-to-464/razmer-70_140_sm/%3Cimg%20id=/%3Cimg%20id=/%3Cimg%20id=/%3Cimg%20id=/%3Cimg%20id=/ HTTP/1.0" 200 21831 "-" "Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots)"
|