Martech Zone has thousands of articles, with many of them outdated. I’ve worked on the site for several years to remove or update hundreds of articles, but I still have many more. At the same time, I’d like to train a natural language bot with my content, but the last thing I want to do is train it on outdated articles.

FastBots is a ChatGPT-powered bot builder that you can initially train using your Sitemap (or other options). I needed a filtered sitemap that included all articles modified since a specific date. Additionally, I wanted to include my pages and acronyms (a custom post type). I didn’t want to include archive pages for categories and tags or have my home page since it’s also an archive.

Using the code I’m providing at the end of this article; I built a custom WordPress plugin that creates a custom XML sitemap that dynamically refreshes each time I publish a post. FastBots doesn’t have an automated retraining method as I publish each article, but this is a great starting point for using the platform.

The sitemap imports all the links to train the AI Bot on:

All pages are now imported, and you can train your bot on the applicable data. You also have the opportunity to remove specific pages. FastBots also allowed me to customize my AI bot’s branding and even include a link to a relevant article in my response. There’s also a lead request built into the platform.

The platform worked flawlessly… you can give my bot a test drive here:

Launch Martech Zone’s Bot, Marty Build Your FastBots AI Bot

Custom XML Sitemap

Rather than add this functionality to my theme, I built a custom WordPress plugin to build out a Sitemap. Just add a directory in your plugins folder, then a PHP file with the following code:

 'post',
        'date_query' => array(
            'column' => 'post_modified',
            'after'  => $mtz_modified_since_date
        ),
        'posts_per_page' => -1 // Retrieve all matching posts
    );

    $postsForSitemap = get_posts($args);

    // Fetch all 'acronym' custom post type posts
    $acronymPosts = get_posts(array(
        'post_type' => 'acronym',
        'posts_per_page' => -1,
    ));

    // Fetch all pages except the home page
    $pagesForSitemap = get_pages();
    $home_page_id = get_option('page_on_front');

    $sitemap = '';
    $sitemap .= '';

    foreach($postsForSitemap as $post) {
        setup_postdata($post);
        if ($post->ID != $home_page_id) {
            $sitemap .= ''.
                          ''. get_permalink($post) .''.
                          ''. get_the_modified_date('c', $post) .''.
                          'weekly'.
                        '';
        }
    }

    foreach($acronymPosts as $post) {
        setup_postdata($post);
        if ($post->ID != $home_page_id) {
            $sitemap .= ''.
                          ''. get_permalink($post) .''.
                          ''. get_the_modified_date('c', $post) .''.
                          'weekly'.
                        '';
        }
    }

    foreach($pagesForSitemap as $page) {
        setup_postdata($page);
        if ($page->ID != $home_page_id) {
            $sitemap .= ''.
                          ''. get_permalink($page) .''.
                          ''. get_the_modified_date('c', $page) .''.
                          'monthly'.
                        '';
        }
    }

    wp_reset_postdata();

    $sitemap .= '';

    file_put_contents(get_home_path().'bot-sitemap.xml', $sitemap);
}

// Activate the initial sitemap build on plugin activation
register_activation_hook(__FILE__, 'build_bot_sitemap');

©2023 DK New Media, LLC, All rights reserved.

Originally Published on Martech Zone: FastBots: Build A Custom WordPress XML Sitemap For Training Your AI Bot