SignupHide Sidebar
Username: 
Password: 
Restrict session to IP 
Statistics
44 Sites
197 Challs
9899 Posts
73485 Users
52 Donations
1 Shop
44 Active Sites
World of Wargame
WeChall
TheBlackSheep
Rankk
Electrica
NewbieContest
BrainQuest
Net-Force
HackThisSite
elhacker.net
TryThis0ne
TDHack
+Ma's Reversing
Hacker.org
HackBBS
Root-Me
SPOJ
Revolution Elite
W3Challs
Gekko
Webhacking.kr
Reversing.Kr
SuNiNaTaS
Yoire
Hacking-Challenges
OverTheWire.org
RedTigers Hackit
ae27ff
pwnable.kr
RingZer0 Team Online CTF
pwnable.tw
Hack The Box
try to decrypt
MysteryTwister
Énigmes À Thématiques
247CTF
CryptoHack
PyDéfis
PromptRiddle
pwn.college
HackMyVM
Hack The Web
GemForgeLabs
mrradio.kr
Top 10 Players
rayaseiren
dloser
jusb3
ytbjplh
tehron
Caesum
tenflo
sisyang
Xaav
noother
Last 20 Activities
ms_nobody
DevilDog
j_m
Jinx
mm301
ossa
boiled_pickles
Jinx
mozaa
yehuju
yehuju
raikoug
peterkodo
jexi
yugandhar
raikoug
sambo
xen-ops
Celcious
benito255
Online within 1d
0 Users
Questions  |  score: 1  |  1,20 3,58 3,45 |  Solved By 11601 People  |  280033 views  |  since Dec 26, 2010 - 23:06:38

Training: WWW-Robots (HTTP, Training)

WWW-Robots
In this little training challenge, you are going to learn about the Robots_exclusion_standard.
The robots.txt file is used by web crawlers to check if they are allowed to crawl and index your website or only parts of it.
Sometimes these files reveal the directory structure instead protecting the content from being crawled.

Enjoy!
© 2010, 2011, 2012, 2013, 2014, 2015, 2016, 2017, 2018, 2019, 2020, 2021, 2022, 2023, 2024, 2025 and 2026 by Gizmore
PHP Fatal Error(1): Constant E_STRICT is deprecated since 8.4, the error level was removed in www/protected/config.php line 6


Backtrace starts in [unknown file] line ?.
GWF_Debug::shutdown_function() core/inc/util/GWF_Debug.php line 109.
GWF_Debug::error_handler().... core/inc/util/GWF_Debug.php line 180.