From phma@webjockey.net Thu Apr 17 20:31:46 2003 Return-Path: X-Sender: phma@ixazon.dynip.com X-Apparently-To: lojban@yahoogroups.com Received: (EGP: mail-8_2_6_5); 18 Apr 2003 03:31:46 -0000 Received: (qmail 93791 invoked from network); 18 Apr 2003 03:31:46 -0000 Received: from unknown (66.218.66.217) by m14.grp.scd.yahoo.com with QMQP; 18 Apr 2003 03:31:46 -0000 Received: from unknown (HELO blackcat.ixazon.lan) (208.150.110.21) by mta2.grp.scd.yahoo.com with SMTP; 18 Apr 2003 03:31:46 -0000 Received: by blackcat.ixazon.lan (Postfix, from userid 1001) id BEB1A4F45; Fri, 18 Apr 2003 03:31:48 +0000 (UTC) Organization: dis To: lojban@yahoogroups.com Subject: Re: [lojban] [OT] wget (was Re: archive of all jboske?) Date: Thu, 17 Apr 2003 23:31:48 -0400 User-Agent: KMail/1.5 References: In-Reply-To: MIME-Version: 1.0 Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: 7bit Content-Disposition: inline Message-Id: <200304172331.48584.phma@webjockey.net> From: Pierre Abbat X-Yahoo-Group-Post: member; u=92712300 X-Yahoo-Message-Num: 19295 On Thursday 17 April 2003 23:11, sshiskom wrote: > > There is no easy way. It can be done with wget and some creativity. > > Let me see what I can do. > > I'm relatively new to UNIX. And when I try > > ---- > $ wget http://groups.yahoo.com/group/lojban/message/1 > ---- > > I get following messages (a bit edited): > > ---- > Connecting to groups.yahoo.com:80... connected! > HTTP request sent, awaiting response... 302 > Location: http://groups.yahoo.com/group/lojban/auth?done=%2Fgroup% > 2Flojban%2Fmessage%2F1 [following] > > Connecting to groups.yahoo.com:80... connected! > HTTP request sent, awaiting response... 302 > Location: http://groups.yahoo.com/group/lojban/auth?check=G&done=% > 2Fgroup%2Flojban%2Fmessage%2F1 [following] > > Connecting to groups.yahoo.com:80... connected! > HTTP request sent, awaiting response... 302 > Location: http://groups.yahoo.com/group/lojban/message/1 [following] > > http://groups.yahoo.com/group/lojban/message/1: Redirection cycle > detected. > ---- > > It seems Yahoo! Groups do some automatic authentication check and > when finished, redirect to the original url. And wget detects > cycle, and stops. > > How to solve this problem? Try curl with the --referer option. Set it to whatever page you looked at before looking at 1. When I use curl without the referer, I get "Aren't you supposed to be somewhere else?".