ç±äºé¢ç®æ¯æ¾å¨ãç¼ç¨è¯è¨ãæ ç®ä¸çï¼ä½æ²¡ææå®å¸æ使ç¨åªç§ç¼ç¨è¯è¨ï¼æéæ©ä½¿ç¨javaè¯è¨æ¥å®ç°ã
å¨Javaä¸ï¼ä½¿ç¨HttpURLConnectionå³å¯è¿æ¥URLï¼éåå¯ä»¥ä½¿ç¨InputStreamReaderè·åç½é¡µå
容ææ¬ãç¶åï¼ä½¿ç¨æ£å表达å¼è§£æç½é¡µå
容ææ¬ï¼æ¾å°ææç<a>æ ç¾å³å®ç°éæ±ã
以ä¸æ¯è¯¦ç»ä»£ç ï¼
import java.io.BufferedReader;
import java.io.IOException;
import java.io.InputStreamReader;
import java.net.HttpURLConnection;
import java.net.URL;
import java.util.ArrayList;
import java.util.regex.Matcher;
import java.util.regex.Pattern;
public class HtmlParser {
/**
* è¦åæçç½é¡µ
*/
String htmlUrl;
/**
* åæç»æ
*/
ArrayList<String> hrefList = new ArrayList();
/**
* ç½é¡µç¼ç æ¹å¼
*/
String charSet;
public HtmlParser(String htmlUrl) {
// TODO èªå¨çæç
æé å½æ°åæ ¹
this.htmlUrl = htmlUrl;
}
/**
* è·ååæç»æ
*
* @throws IOException
*/
public ArrayList<String> getHrefList() throws IOException {
parser();
return hrefList;
}
/**
* 解æç½é¡µé¾æ¥
*
* @return
* @throws IOException
*/
private void parser() throws IOException {
URL url = new URL(htmlUrl);
HttpURLConnection connection = (HttpURLConnection) url.openConnection();
connection.setDoOutput(true);
String contenttype = connection.getContentType();
charSet = getCharset(contenttype);
InputStreamReader isr = new InputStreamReader(
connection.getInputStream(), charSet);
BufferedReader br = new BufferedReader(isr);
String str = null, rs = null;
while ((str = br.readLine()) != null) {
rs = getHref(str);
if (rs != null)
hrefList.add(rs);
}
}
/**
* è·åç½é¡µç¼ç æ¹å¼
*
* @param str
*/
private String getCharset(String str) {
Pattern pattern = Pattern.compile("charset=.*");
Matcher matcher = pattern.matcher(str);
if (matcher.find())
return matcher.group(0).split("charset=")[1];
return null;
}
/**
* ä»ä¸è¡
å符串ä¸è¯»åé¾æ¥
*
* @return
*/
private String getHref(String str) {
Pattern pattern = Pattern.compile("<a href=.*</a>");
Matcher matcher = pattern.matcher(str);
if (matcher.find())
return matcher.group(0);
return null;
}
public static void main(String[] arg) throws IOException {
HtmlParser a = new HtmlParser("
http://news.163.com/");
ArrayList<String> hrefList = a.getHrefList();
for (int i = 0; i < hrefList.size(); i++)
System.out.println(hrefList.get(i));
}
}