• 북마크

eyoom4 커뮤니티

robots.txt 설정 파일 - 쇼핑몰 제외, 기본 홈페이지 형식만 운영할 경우

  • - 첨부파일 : robots.txt (1.6K) - 다운로드

본문

User-agent: AhrefsBot

Disallow: /


User-agent: archive.org_bot

Disallow: /


User-agent: BDCbot

Disallow: /


User-agent: BusinessBot

Disallow: /


User-agent: Dataprovider.com

Disallow: /


User-agent: DialogSearch.com Bot

Disallow: /


User-agent: Digincore crawler bot

Disallow: /


User-agent: DomainSigmaCrawler

Disallow: /


User-agent: kisaBot

Disallow: /


User-agent: Mail.RU_Bot

Disallow: /


User-agent: MediavBot

Disallow: /


User-agent: memoryBot

Disallow: /


User-agent: mfibot

Disallow: /


User-agent: MJ12bot

Disallow: /


User-agent: msnbot-media

Disallow: /


User-agent: NeumobBot

Disallow: /


User-agent: PageAnalyzer

Disallow: /


User-agent: PagesInventory

Disallow: /


User-agent: Plukkie

Disallow: /


User-agent: roboto

Disallow: /


User-agent: rogerbot

Disallow: /


User-agent: RSNBOT

Disallow: /


User-agent: SafeDNSBot

Disallow: /


User-agent: semanticbot

Disallow: /


User-agent: SMTBot

Disallow: /


User-agent: SurveyBot

Disallow: /


User-agent: TurnitinBot

Disallow: /


User-agent: UXCrawlerBot

Disallow: /


User-agent: Wotbox

Disallow: /


User-agent: YandexBot

Disallow: /



User-agent: AdsBot-Naver

allow:


User-agent: bingbot

allow:


User-agent: Daum

allow:


User-agent: Googlebot

allow:


User-agent: Googlebot-Mobile

allow:


User-agent: Yeti

allow:


User-agent: ZumBot

allow:


Disallow: /adm/ 

Disallow: /data/

Disallow: /extend/

Disallow: /install/

Disallow: /js/

Disallow: /lib/

Disallow: /plugin/

Disallow: /skin/

Disallow: /theme/

Disallow: /shop/


댓글목록 0

등록된 댓글이 없습니다.