基于算法的网页正文识别与提取实践

    pip3 install newspaper3k
    
    
      
    

    >>> from newspaper import Article
    >>> url = ''
    >>> article = Article(url, language = 'zh')
    >>> article.download()
    >>> article.parse()
    Building prefix dict from /usr/local/lib/python3.7/site-packages/jieba/dict.txt ...
    Dumping model to file cache /var/folders/zf/n2xjp7t53yg_m7wyrjt6p1_40000gn/T/jieba.cache
    Loading model cost 2.059746742248535 second