8 {{ upvoteCount | shortNum }}
8 {{ upvoteCount | shortNum }}

Large datafeed sites and Google

by majestic12
7 replies
Hi there,

I am not a newbie when it comes to SEO however am when it comes to datafeeds, I have a couple of basic questions I would dearly love answered.

I have a site which I want to add a 30000 product datafeed to, each page will have a unique twist.

1. Can I upload all pages in one go?
2. When the pages are uploaded I want to update the feed "once" per week, do I remove the previouse 30000 and upload the new 30000?


Now I do not want to have outdated products on my site so replacing them seems logical, surely the large web companies will do this?

Anyhow am a little lost here so would greatyl value the advice of a "pro" large product base datafeed user.

Many thanks...
David
Many thanks
#datafeed #google #large #sites
  • Profile picture of the author tpw
    This is a little more difficult, if you are making any manual changes to the data.

    If it is simply taking the datafeed each week and putting up pages in real time, then deleting the old and uploading the new makes sense.

    But if you are doing any customization to the feed data, then you will want to push the new into one database table, then do a cross-compare of the new and old tables, deleting the discontinued items and leaving the old data for the original records untouched.
    Signature
    Bill Platt, Oklahoma USA, PlattPublishing.com
    Publish Coloring Books for Profit (WSOTD 7-30-2015)
    {{ DiscussionBoard.errors[2626084].message }}
  • Profile picture of the author majestic12
    Hi Bill

    Thanks for the reply... yes a cross compare sounds a brilliant idea...

    My datafeeds will be in excel

    So I will need a way to do this..

    I will have to figure out a way of comparing the old excel with the new in order to give me a third excel that that contains new products and has removed withdrawn products...

    That has gvien me something to think about...

    Many thanks..
    {{ DiscussionBoard.errors[2626100].message }}
  • Profile picture of the author seasoned
    majestic12,

    You are asking these questions, so OBVIOUSLY you didn't write it! If you wrote it, it would be silly to ask these questions.

    Likewise, it is silly to ask us such questions with NO details!

    BTW SQL DOES allow you to do ALL of it. You can even have a dirty read done, update all items, and ONLY on 100% success have it appear, assuming it can handle transactions. EVEN THEN it depends on the application.

    Steve
    {{ DiscussionBoard.errors[2626262].message }}
    • Profile picture of the author majestic12
      Originally Posted by seasoned View Post

      majestic12,

      You are asking these questions, so OBVIOUSLY you didn't write it! If you wrote it, it would be silly to ask these questions.

      Likewise, it is silly to ask us such questions with NO details!

      BTW SQL DOES allow you to do ALL of it. You can even have a dirty read done, update all items, and ONLY on 100% success have it appear, assuming it can handle transactions. EVEN THEN it depends on the application.

      Steve
      Sorry seasoned,not sure what you mean by "you didnt write it"?

      As for details I will be adding a feed to an existing site, with normal sites I thought we had to add pages slowly. Clearly adding a large datafeed every week made me wonder if this was OK with google.. with this feed the merchant deals change very quickly, that is why I wanted to update...

      As I said I am just learning, sorry if the questions seemed silly..

      Regards David..
      {{ DiscussionBoard.errors[2626340].message }}
      • Profile picture of the author majestic12
        Originally Posted by majestic12 View Post

        Sorry seasoned,not sure what you mean by "you didnt write it"?

        As for details I will be adding a feed to an existing site, with normal sites I thought we had to add pages slowly. Clearly adding a large datafeed every week made me wonder if this was OK with google.. with this feed the merchant deals change very quickly, that is why I wanted to update...

        As I said I am just learning, sorry if the questions seemed silly..

        Regards David..
        Just read my original post and can see why it may not seem clear, what I meant was is it OK in Googles eyes to upload such a large amount of pages so fast? then after a week replace so many of them..

        Regards.. David
        {{ DiscussionBoard.errors[2626363].message }}
  • Profile picture of the author Ross Dalangin
    If the pages are already indexed then create a 404 page to display that the page they are looking has been removed and then put a search box asking your visitors to try searching again in your database. This way you still have pages competing search results.
    {{ DiscussionBoard.errors[2626380].message }}
    • Profile picture of the author majestic12
      Originally Posted by Ross Dalangin View Post

      If the pages are already indexed then create a 404 page to display that the page they are looking has been removed and then put a search box asking your visitors to try searching again in your database. This way you still have pages competing search results.
      Thanks Ross, I use wordpress so "think" that provides a 404. I will just have to see about customizing it,,

      Many thanks
      {{ DiscussionBoard.errors[2627035].message }}

Trending Topics