如何实现这样的爬虫程序(有些难度)? z

Osirix · 发表于 2006-8-3 22:28:07

网站用的是ASP.NET+MSSQL, 需要POST Data登陆(序号和密码方式),Post的目标页面是ASP.NET页面,在要提交的Form里都有一个__ViewState隐藏Input字段；提交后会出来包含一个/info/index.aspx连接的页面(根据相应的序号产生的)
详细网页源码已附在下面

现在有一堆序号, 范围分别为1000-1100,2100-2200,3100-3200,...
密码都是000,想自动在登陆后向页面/info/index.aspx发送请求并下载该页面,把文件名保存为：<相应的序号>.html

该如何实现呢?

对网络编程不太懂,只晓得用类似
http://192.168.0.1/xxx.aspx?__EV ... x=35&imgDl.y=14
可以自动登陆

附: 登陆页面xxx.aspx的代码如下:

<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.0 Transitional//EN" >
<HTML>
<HEAD>
<title>xxx</title>
<meta name="GENERATOR" Content="Microsoft Visual Studio .NET 7.1">
<meta name="CODE_LANGUAGE" Content="C#">
<meta name="vs_defaultClientScript" content="JavaScript">
<meta name="vs_targetSchema" content="http://schemas.microsoft.com/intellisense/ie5">
<link href="images/style.css" rel="stylesheet" type="text/css">
<link type=text/css rel="stylesheet" href=css/page.css>
<script language="javascript">
function window.onload()
{
var a="a";
if(a=="a")
{
document.all.tabDl.style.display="";
document.all.tabcc.style.display="none";
frmxs.action="./new.aspx"
frmxs.submit();
}
else
{
document.all.tabDl.style.display="none";
document.all.tabcc.style.display="";
frmxs.submit();
}
}
function check()
{
if(document.all.txtXh.value=="")
{
alert("UserName！");
document.all.txtXh.focus()
return false;
}
if(document.all.txtPwd.value=="")
{
alert("Passwd！");
document.all.txtPwd.focus()
return false;
}
__doPostBack('imgDl','');
}
</script>
<meta http-equiv="Content-Type" content="text/html; charset=gb2312">
<style type="text/css">
<!-- body { margin-left: 0px; margin-right: 0px; background-color: #ECE9D8; background-image:url(image/1Bg.gif)}
.STYLE27 {font-size: 16px}
.STYLE28 {color: #993300}
.STYLE29 {color: #000000}
.STYLE30 {font-size: 14px}
.STYLE31 {
font-family: "宋体";
font-size: 12px;
}
-->
</style>
</HEAD>
<body MS_POSITIONING="GridLayout">
<form name="Form1" method="post" action="xxx.aspx" id="Form1">
<input type="hidden" name="__EVENTTARGET" value="" />
<input type="hidden" name="__EVENTARGUMENT" value="" />
<input type="hidden" name="__VIEWSTATE" value="dDwtMTEwNzUxODYyNjs7bDxpbWdEbDs+PjxVpZI4R4rCovdVGkjO4kUdc2fB" />
<script language="javascript" type="text/javascript">
<!--
function __doPostBack(eventTarget, eventArgument) {
var theform;
if (window.navigator.appName.toLowerCase().indexOf("microsoft") > -1) {
theform = document.Form1;
}
else {
theform = document.forms["Form1"];
}
theform.__EVENTTARGET.value = eventTarget.split("$").join(":");
theform.__EVENTARGUMENT.value = eventArgument;
theform.submit();
}
// -->
</script>
<table id="tabDl" width="197" height="135" border="0" align="left" cellpadding="0" cellspacing="0">
<tr>
<td width="197" height="35" align="center" valign="middle" background="image/bodyTop.gif" > <div align="center">入口</div></td>
</tr>
<tr>
<td width="197" height="115" align="center" valign="top" >
<table width="100%" height="17%" align="center" cellpadding="0" cellspacing="0" id="Table1">
<tbody>
<tr>
<td height="30" align="center" ><span style="WIDTH: 37px"><span style="WIDTH: 37px"><span style="WIDTH: 37px">UserName</span></span></span>
<input name="txtXh" id="txtXh" type="text" style="BORDER-RIGHT: 1px solid; BORDER-TOP: 1px solid; BORDER-LEFT: 1px solid; WIDTH: 80px; BORDER-BOTTOM: 1px solid" maxlength="50" /></td>
</tr>
<tr>
<td height="30" align="center" ><span style="WIDTH: 37px"><span style="WIDTH: 37px"><span style="WIDTH: 37px">Passwd</span></span></span>
<input name="txtPwd" id="txtPwd" type="password" style="BORDER-RIGHT: 1px solid; BORDER-TOP: 1px solid; BORDER-LEFT: 1px solid; WIDTH: 80px; BORDER-BOTTOM: 1px solid" maxlength="80" /></td>
</tr>
<tr>
<td height="27" align="center" ><input src="images/dl.gif" name="imgDl" id="imgDl" type="image" onClick="return check();" onMouseOver="this.style.cursor='hand'" /></td>
</tr>
<tr> </tr>
</tbody>
</table>
<table width="92%" height="20%" align="center" cellpadding="0" cellspacing="0">
<tbody>
</tbody>
</table>
</td>
</tr>
</table>
<table id="tabcc" height="104" cellSpacing="0" cellPadding="0" width="197" align="left"
border="0">
<tr>
<td width="129" height="104"><table width="97%" height="96" border="0" align="center" cellpadding="0" cellspacing="0" class="table2" id="Table1">
<tbody>
<tr>
<td width="197" height="35"colspan="3" align="center" valign="middle" background="image/bodyTop.gif" > <div align="center">入口</div></td>
</tr>
<tr>
<td height="22" colspan="2" class="style6">UserName:</td>
<td width="59%"><div class="style6"></div></td>
</tr>
<tr>
<td height="22" colspan="2" class="style6">Name:</td>
<td><div class="style6"></div></td>
</tr>
<tr>
<td width="21%" height="18" align="center" class="style6"><span class="style11"><span class="style8"><img src="images/dh3.gif" width="11" height="11"></span></span></td>
<td height="26" colspan="2" align="left" class="style6"><a href="./info/index.aspx" target="frm" onMouseOver="this.style.color='#99CCFF'" onMouseOut="this.style.color='#FF3300'"><strong>查看信息</strong></a></td>
</tr>
<tr>
<td height="17" align="center" class="style6"><span class="style11"><span class="style8"><img src="images/dh3.gif" width="11" height="11"></span></span></td>
<td height="27" colspan="2" align="left" class="style6"><a href="./info/pwd.aspx" target="frm" onMouseOver="this.style.color='#99CCFF'" onMouseOut="this.style.color='#FF3300'"><strong>修改密码</strong></a></td>
</tr>
<tr>
<td height="17" align="center" class="style6"><span class="style11"><span class="style8"><img src="images/dh3.gif" width="11" height="11"></span></span></td>
<td height="27" colspan="2" align="left" class="style6"><a id="hTc" name="hTc" onMouseOver="this.style.color='#99CCFF'" onMouseOut="this.style.color='#FF3300'" href="javascript:__doPostBack('hTc','')"><strong>退出登录</strong></a></td>
</tr>
<tr>
<td height="8" colspan="3" align="center"></td>
</tr>
</tbody>
</table>
</td>
</tr>
</table>
</form>
<form name="frmxs" method="post" action="./info/index.aspx" target="frm" >
</form>
</body>
</HTML>

复制代码

用下载软件如flashget 下载 "http://192.168.0.1/xxx.aspx?__EVENTTARGET=imgDl&__EVENTARGUMENT=&__VIEWSTATE=dDwtMTEwNzUxODYyNjs7bDxpbWdEbDs%2BPjxVpZI4R4rCovdVGkjO4kUdc2fB&txtXh=1000&txtPwd=000&imgDl.x=35&imgDl.y=14" 得到的html是这样子的:

<script language='javascript'>window.location='./xxx.aspx';</script>
<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.0 Transitional//EN" >
<HTML>
<HEAD>
<title>xxx</title>
<meta name="GENERATOR" Content="Microsoft Visual Studio .NET 7.1">
<meta name="CODE_LANGUAGE" Content="C#">
<meta name="vs_defaultClientScript" content="JavaScript">
<meta name="vs_targetSchema" content="http://schemas.microsoft.com/intellisense/ie5">
<link href="images/style.css" rel="stylesheet" type="text/css">
<link type=text/css rel="stylesheet" href=css/page.css>
<script language="javascript">
function window.onload()
{
var a="a";
if(a=="a")
{
document.all.tabDl.style.display="";
document.all.tabcc.style.display="none";
frmxs.action="./new.aspx"
frmxs.submit();
}
else
{
document.all.tabDl.style.display="none";
document.all.tabcc.style.display="";
frmxs.submit();
}
}
function check()
{
if(document.all.txtXh.value=="")
{
alert("璇疯惧ュ宸锛");
document.all.txtXh.focus()
return false;
}
if(document.all.txtPwd.value=="")
{
alert("璇疯惧ュ狅?);
document.all.txtPwd.focus()
return false;
}
__doPostBack('imgDl','');
}
</script>
<meta http-equiv="Content-Type" content="text/html; charset=gb2312">
<style type="text/css">
<!-- body { margin-left: 0px; margin-right: 0px; background-color: #ECE9D8; background-image:url(image/1Bg.gif)}
.STYLE27 {font-size: 16px}
.STYLE28 {color: #993300}
.STYLE29 {color: #000000}
.STYLE30 {font-size: 14px}
.STYLE31 {
font-family: "瀹浣";
font-size: 12px;
}
-->
</style>
</HEAD>
<body MS_POSITIONING="GridLayout">
<form name="Form1" method="post" action="xxx.aspx?__EVENTTARGET=imgDl&__EVENTARGUMENT=&__VIEWSTATE=dDwtMTEwNzUxODYyNjs7bDxpbWdEbDs%2BPjxVpZI4R4rCovdVGkjO4kUdc2fB&txtXh=1000&txtPwd=passwd000&imgDl.x=35&imgDl.y=14" id="Form1">
<input type="hidden" name="__EVENTTARGET" value="" />
<input type="hidden" name="__EVENTARGUMENT" value="" />
<input type="hidden" name="__VIEWSTATE" value="dDwtMTEwNzUxODYyNjs7bDxpbWdEbDs+PjxVpZI4R4rCovdVGkjO4kUdc2fB" />
<script language="javascript" type="text/javascript">
<!--
function __doPostBack(eventTarget, eventArgument) {
var theform;
if (window.navigator.appName.toLowerCase().indexOf("microsoft") > -1) {
theform = document.Form1;
}
else {
theform = document.forms["Form1"];
}
theform.__EVENTTARGET.value = eventTarget.split("$").join(":");
theform.__EVENTARGUMENT.value = eventArgument;
theform.submit();
}
// -->
</script>
<table id="tabDl" width="197" height="135" border="0" align="left" cellpadding="0" cellspacing="0">
<tr>
<td width="197" height="35" align="center" valign="middle" background="image/bodyTop.gif" > <div align="center">瀛︾?ュ?/div></td>
</tr>
<tr>
<td width="197" height="115" align="center" valign="top" >
<table width="100%" height="17%" align="center" cellpadding="0" cellspacing="0" id="Table1">
<tbody>
<tr>
<td height="30" align="center" ><span style="WIDTH: 37px"><span style="WIDTH: 37px"><span style="WIDTH: 37px">瀛﹀?/span></span></span>
<input name="txtXh" id="txtXh" type="text" style="BORDER-RIGHT: 1px solid; BORDER-TOP: 1px solid; BORDER-LEFT: 1px solid; WIDTH: 80px; BORDER-BOTTOM: 1px solid" maxlength="50" value="1000" /></td>
</tr>
<tr>
<td height="30" align="center" ><span style="WIDTH: 37px"><span style="WIDTH: 37px"><span style="WIDTH: 37px">瀵鐮</span></span></span>
<input name="txtPwd" id="txtPwd" type="password" style="BORDER-RIGHT: 1px solid; BORDER-TOP: 1px solid; BORDER-LEFT: 1px solid; WIDTH: 80px; BORDER-BOTTOM: 1px solid" maxlength="80" /></td>
</tr>
<tr>
<td height="27" align="center" ><input src="images/dl.gif" name="imgDl" id="imgDl" type="image" onClick="return check();" onMouseOver="this.style.cursor='hand'" /></td>
</tr>
<tr> </tr>
</tbody>
</table>
<table width="92%" height="20%" align="center" cellpadding="0" cellspacing="0">
<tbody>
</tbody>
</table>
</td>
</tr>
</table>
<table id="tabcc" height="104" cellSpacing="0" cellPadding="0" width="197" align="left"
border="0">
<tr>
<td width="129" height="104"><table width="97%" height="96" border="0" align="center" cellpadding="0" cellspacing="0" class="table2" id="Table1">
<tbody>
<tr>
<td width="197" height="35"colspan="3" align="center" valign="middle" background="image/bodyTop.gif" > <div align="center">瀛︾?ュ?/div></td>
</tr>
<tr>
<td height="22" colspan="2" class="style6">瀛?宸:</td>
<td width="59%"><div class="style6"></div></td>
</tr>
<tr>
<td height="22" colspan="2" class="style6">濮 ?</td>
<td><div class="style6"></div></td>
</tr>
<tr>
<td width="21%" height="18" align="center" class="style6"><span class="style11"><span class="style8"><img src="images/dh3.gif" width="11" height="11"></span></span></td>
<td height="26" colspan="2" align="left" class="style6"><a href="./info/index.aspx" target="frm" onMouseOver="this.style.color='#99CCFF'" onMouseOut="this.style.color='#FF3300'"><strong>妤玟俊姣</strong></a></td>
</tr>
<tr>
<td height="17" align="center" class="style6"><span class="style11"><span class="style8"><img src="images/dh3.gif" width="11" height="11"></span></span></td>
<td height="27" colspan="2" align="left" class="style6"><a href="./info/pwd.aspx" target="frm" onMouseOver="this.style.color='#99CCFF'" onMouseOut="this.style.color='#FF3300'"><strong>淇瑰?/strong></a></td>
</tr>
<tr>
<td height="17" align="center" class="style6"><span class="style11"><span class="style8"><img src="images/dh3.gif" width="11" height="11"></span></span></td>
<td height="27" colspan="2" align="left" class="style6"><a id="hTc" name="hTc" onMouseOver="this.style.color='#99CCFF'" onMouseOut="this.style.color='#FF3300'" href="javascript:__doPostBack('hTc','')"><strong>殄虹诲?/strong></a></td>
</tr>
<tr>
<td height="8" colspan="3" align="center"></td>
</tr>
</tbody>
</table>
</td>
</tr>
</table>
</form>
<form name="frmxs" method="post" action="./info/index.aspx" target="frm" >
</form>
</body>
</HTML>

复制代码

		自动登录	找回密码
密码			注册

如何实现这样的爬虫程序(有些难度)? z

浏览过的版块