아래와 같은 이상한 로그가 계속 나오더군요. ^^ 트래픽을 상당히 잡아먹고 있는 BLEXBOT 크롤러를 차단하려면

robots.txt 파일을 만들어서 다음과 같이 저장후 업로드하세요

User-agent: BLEXBot

Disallow: /

144.76.107.164 - - [25/Jul/2016:10:31:24 +0900] "GET /bbs/h-pr--0_308_26_-1.html HTTP/1.1" 404 224 "-" "Mozilla/5.0 (compatible; BLEXBot/1.0; +http://webmeup-crawler.com/)"
144.76.107.164 - - [25/Jul/2016:10:31:29 +0900] "GET /bbs/h-pr--0_308_27_-1.html HTTP/1.1" 404 224 "-" "Mozilla/5.0 (compatible; BLEXBot/1.0; +http://webmeup-crawler.com/)"
144.76.107.164 - - [25/Jul/2016:10:31:33 +0900] "GET /bbs/h-pr--0_308_29_-1.html HTTP/1.1" 404 224 "-" "Mozilla/5.0 (compatible; BLEXBot/1.0; +http://webmeup-crawler.com/)"
144.76.107.164 - - [25/Jul/2016:10:31:38 +0900] "GET /bbs/h-pr--0_308_30_-1.html HTTP/1.1" 404 224 "-" "Mozilla/5.0 (compatible; BLEXBot/1.0; +http://webmeup-crawler.com/)"
144.76.107.164 - - [25/Jul/2016:10:31:42 +0900] "GET /bbs/h-pr--0_308_31_-1.html HTTP/1.1" 404 224 "-" "Mozilla/5.0 (compatible; BLEXBot/1.0; +http://webmeup-crawler.com/)"

144.76.107.164 - - [25/Jul/2016:10:31:46 +0900] "GET /bbs/h-pr--0_308_32_-1.html HTTP/1.1" 404 224 "-" "Mozilla/5.0 (compatible; BLEXBot/1.0; +http://webmeup-crawler.com/)"