Skip to main content

Google Gives Publishers More Control Over How It Crawls Their News




Yesterday, Google threw complaining publishers a bone with its First Click Free program, which lets news sites limit the number of free clicks from Google News for any individual to five a day. News sites have long been accusing Google of profiting off of their news with Google News but today Google is making another concession to publishers.

Google is launching a new crawler that will let publishers keep their content out of Google News and still remain in Google Search. Publishers have always been able to do this by filling out a contact form but now Google is making it easier by automating the technology with a news-crawler.



Yesterday, Google threw complaining publishers a bone with its First Click Free program, which lets news sites limit the number of free clicks from Google News for any individual to five a day. News sites have long been accusing Google of profiting off of their news with Google News but today Google is making another concession to publishers.


Google is launching a new crawler that will let publishers keep their content out of Google News and still remain in Google Search. Publishers have always been able to do this by filling out a contact form but now Google is making it easier by automating the technology with a news-crawler.


Currently, publishers can block Google from including their content in Google’s main index via a Robots Exclusion Protocol (or REP). When Google’s crawler arrives at any site, it checks to see if there’s a robots.txt file to make sure the search engine has permission to crawl the site. This gives publishers the option to block an entire site or certain sections or pages.


Google is applying this technology specifically to News. News sites can now block images from thew news crawlers but not from general web search. Or on the flipside, a news site could choose to index their content on Google News but not Google’s main search index. If a publisher decides to opt out of Google News but still wants to be indexed on Google Search, content will show up in search results, but won’t appear in the block of news results that sometimes shows up in Web Search.


Publishers stand to gain from indexing on Google news, with News sending publishers about 1 billion clicks every month (and 4 billion clicks per month from all of Google). Josh Cohen, Senior Product Manager For Google News writes:


Each of those clicks is an opportunity for publishers, allowing them to show ads, sell subscriptions and introduce readers to the great content they produce every day. While we think this offers a tremendous opportunity for any publisher who wants new readers, publishers are the ones who create the content and they’re in control of it. If they decide they don’t want to be in Google, it’s easy to do.


The new crawler gives publishers like Rupert Murdoch even more ways to block their news from Google. It’s a Christmas wish come true.


Crunch Network: CrunchBase the free database of technology companies, people, and investors












Comments

Popular posts from this blog

How to find ideas to post new article in your blog

How to find ideas to post new article in your blog    阅读原文»   It is true that sometimes being a blogger may face situations where I would personally like to call it your brain juices got dried up as you have pretty much ran out of topic to blog and you are in crisis as your readers are anxiously waiting for your new posts but you are unable to give in. That’s when you will probably come with excuses like I just posted last week although that post was more directly towards the newbies who stop themselves from making money but it’s still pretty much the same even though you consider yourself not a newbie. The fact is that ideas are everywhere and I mean everywhere if you know where to find it and know how to leverage it. You may be surprised that sometimes these ideas are just right in front of you but you are not observant enough to convert these ideas and turn it into your blog post. Today I will share some tips on where to get these ideas and most of it is part of your dai

Lindsay Lohan Breakup Confirmed by Lohan, Locksmith, Police [Gossip Roundup]

Farewell, last season's Suri Cruise fashions. Goodbye, Amy Winehouse's bathing suit. Adieu, humanoid version of Lauren Conrad. And so long, LiLo and SamRon's fairytale romance. Lindsay Lohan confirmed her split with Samantha Ronson and insisted the decision was part of a very healthy and mature effort to " focus on myself ." Upon hearing this, Ronson changed her locks and discussed a restraining order with police, so confident was she in Lohan's ability to turn productively inward. Lohan promptly had a run-in with the police . Who would have imagined such a messy breakup for this model relationship? Courtney Love's lawyer, on her client's drug-fueled plunge into broke-ness: ""Courtney noticed the money was gone when there wasn't any left." Deadpan gallows humor: the only possible response to having Courtney Love as a client. (Besides asking for a hefty retainer.) [ P6 ] Before Lauren Conrad's contract expired in March, MT

部门心脏?

i.am.weihua.1234您好!!              生产计划与物料控制PMC高级研修班 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 课程背景: 生产计划和物料控制(PMC)部门是一个企业"心脏", 掌握着企业生产及物料运作的总调度 和命脉,统筹营运资金、物流、信息等动脉,直接涉及影响生产部、生产工程部、采购、货仓、品 控部、开发与设计部、设备工程、人力资源及财务成本预算控制等,其制度和流程决定公司盈利成 败.因此PMC部门和相关管理层必须充分了解:物料计划、请购、物料调度、物料控制(收、发、退、 借、备料等)、生产计划与生产进度控制,并谙熟运用这门管理技术来解决问题,学习拉动计划价 值流(VSM)图,从拉动计划价值流切入剖析工厂制造成本和缩短制造周期 ,提高物流过程循环效 率(库存、资金的周转率)及客户满意率;为降低或消除物流过程中的非增值活动. ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 课程目标: 1、建立制定完善的生产与物控运作体系?提升准时交货和降低库存成本 2、预测及制定合理的短、中、长期销售计划?达成公司策略管理目标 3、对自身的生产能力负荷预先进行详细分析并建立完善产品数据机制协助公司建立产品工程数据 4、生产前期做好完整的生产排程和周生产计划?提高备料准确率,保持生产顺畅 5、配合生产计划做到良好物料损耗控制和备料?完善降低物料损耗机制和停工待料工时 6、对生产进度及物料进度及时跟进和沟通协调?缩短生产周期,提高企业竞争力 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 报名详情: 培训时间:2012年11月 3- 4深圳 11月15-16上海 11月22-23北京 12月 1- 2广州 承办单位:新 活 力 顾 问 培训对象:生产计划部门、物料计划部门、采购部门、 生产部门、销售部门、物流、研发部门、 PIE、IT 培训费用:3200元/人(包括资料费、午餐及上下午茶点等) 报名热线:400-623-8399 (免长途话费) 电邮: maomao@xhlpx.com QQ:120915