Noindex based on min word count?

w1ckedsick · June 2015

Please can someone provide me an IF statement I can insert somewhere so that any thread pages with a word count below X will have the following added:
<meta name="robots" content="noindex"/>

Reason being is I'd like to try and minimise what might be considered 'thin content' to Google and although word count is only one factor, it's an effective one.

x00 · June 2015

I think you are taking the phrase too literally

watch this video

https://support.google.com/webmasters/answer/2604719?hl=en

it is nothing to do with succinct discussions. You can have really useful questions that are short, with a single simple answer.

You are far better off encouraging the behaviours you want, rather than trying to prevent indexing on low quality content.

w1ckedsick · June 2015

I appreciate your point and working the leading SEO agency in Europe, I do have a reasonable grasp of this. The nature of my forum is there are a lot of 'request' one liner topics that offer no value for searchers but it would not be reasonable for me to try and stop that activity.

I understand thin content is not simply about word count but it just so happens that limiting word count in my situation would prevent indexing topics that might get flagged by Panda. Also many of the one liner topics are similar to previous ones, and canonical tags are not an option, so word count restriction would simply rule those similar topics out anyway.

Is there a way to do the IF statement mentioned in first post?

hgtonight · June 2015

I assume you want to filter on the number of words in the discussion and comments bodies.

public function discussionController_render_before($sender) {
    $threshold = C('AutoNoIndex.Threshold', 100);
    $wordCount = str_word_count($sender->Discussion->Body);

    if($wordCount >= $threshold) {
        return;
    }

    $comments = $sender->Data('Comments', array());
    foreach($comments as $comment) {
        $wordCount += str_word_count($comment->Body);

        if($wordCount >= $threshold) {
            return;
        }
    }

    $sender->Head->AddTag('meta', array('name' => 'robots', 'content' => 'noindex'));
}

You can adjust the word count threshold via the following configuration in /conf/config.php:

$Configuration['AutoNoIndex']['Threshold'] = 10;

x00 · June 2015

Again you will need to encourage your users to make make better topics, there are a number of ways to do that from interface to behavioural incentives.

If you want to add noindex conditionally in a theme hooks file you can add this hook

public function DiscussionController_Render_Before($Sender){
    if (isset($Sender->Discussion) && str_word_count(Gdn_Format:Text($Sender->Discussion->Body)) < 10) {
        $Sender->Head->AddTag('meta', array('name'=>'robots', 'content'=>'noindex'));
   }
}

This will also trap tag only posts such as links and videos, as it is taking a text only version of the body rather then tags which are not easily taken into consideration.

A better idea would to flag this up during posting, by trigging a validation error. To encourage better quality posts.

w1ckedsick · June 2015

Thanks guys.

Encouraging better discussion really wouldn't help at all. When they create request topics, it is correct for it to only be a couple of sentences and of minimal value to outside world. Ideally I would just put them all in a requests sub-forum and block the directory. However, half of these requests actually turn into discussions and therefore are of value for searchers but I don't have time to moderate and move them on a per topic basis.

phreak · June 2015

+1 very interesting appeal.

w1ckedsick · June 2015

@hgtonight Where exactly do you place your code? I tried in bootstrap.early/before/after.php but it all caused the forum to load a blank page. I tried removing 'public' from your code which allowed the forum load but the code didn't seem to actually work.

hgtonight · June 2015

Put it in your favorite plugin.

Don't have one?

Plugin Quickstart: http://docs.vanillaforums.com/developers/plugins/quickstart/
My Testing Ground: http://github.com/hgtonight/Plugin-TestingGround

w1ckedsick · June 2015

Never created a plugin before so what I did was I downloaded your 'Testing Ground' and dumped your code at the bottom of class.testingground.plugin.php and it seems to be working. Is this what you had in mind?

hgtonight · June 2015

@w1ckedsick said:
Never created a plugin before so what I did was I downloaded your 'Testing Ground' and dumped your code at the bottom of class.testingground.plugin.php and it seems to be working. Is this what you had in mind?

Sounds good to me.

w1ckedsick · June 2015

@hgtonight Is your 'Testing Ground' compatible with latest version of Vanilla? When enabled you can't use basic functionality such as deleting topics as it just gives a discussion controller error.

w1ckedsick · June 2015

Ok, when I remove 'noindex' code from your plugin container, the forum is fine. So perhaps something in the code you provided me is causing this problem. Any ideas?

hgtonight · June 2015

Enable the debugger plugin, then the testing ground plugin. This should give you an error instead of an "nice" error.

w1ckedsick · June 2015

Ok so I enabled debugger in config and this is what I get when I try and delete a topic:

FATAL ERROR IN: DiscussionController.__get();

"DiscussionController->Discussion not found."

LOCATION: /home/mywebsite/site/public_html/forum/applications/vanilla/controllers/class.discussioncontroller.php

40: Deprecated('DiscussionController->CommentData', "DiscussionController->Data('Comments')");
41: return $this->Data('Comments');
42: break;
43: }

44: throw new Exception("DiscussionController->$Name not found.", 400);

45: }
46:
47: /**
48: * Default single discussion display.

BACKTRACE:
[/home/mywebsite/site/public_html/forum/plugins/Noindex/class.testingground.plugin.php 76] DiscussionController->__get();
[/home/mywebsite/site/public_html/forum/library/core/class.pluginmanager.php 705] TestingGround->discussionController_render_before();
[/home/mywebsite/site/public_html/forum/library/core/class.pluginmanager.php 638] Gdn_PluginManager->CallEventHandler();
[/home/mywebsite/site/public_html/forum/library/core/class.pluggable.php 196] Gdn_PluginManager->CallEventHandlers();
[/home/mywebsite/site/public_html/forum/applications/vanilla/controllers/class.discussioncontroller.php 608] Gdn_Pluggable->__call();
[/home/mywebsite/site/public_html/forum/applications/vanilla/controllers/class.discussioncontroller.php 608] DiscussionController->Render();
[/home/mywebsite/site/public_html/forum/applications/vanilla/controllers/class.discussioncontroller.php 608] DiscussionController->Delete();
[/home/mywebsite/site/public_html/forum/library/core/class.dispatcher.php 350] PHP::call_user_func_array();
[/home/mywebsite/site/public_html/forum/index.php 46] Gdn_Dispatcher->Dispatch();

w1ckedsick · June 2015

Please can aonyone figure out why @hgtonight 'noindex' code is causing discussion controller errors on most of the forum functions? Deleting, favouriting etc.

Reminder of @hgtonight 's code:

public function discussionController_render_before($sender) {
    $threshold = C('AutoNoIndex.Threshold', 100);
    $wordCount = str_word_count($sender->Discussion->Body);
    if($wordCount >= $threshold) {
        return;
    }
    $comments = $sender->Data('Comments', array());
    foreach($comments as $comment) {
        $wordCount += str_word_count($comment->Body);
        if($wordCount >= $threshold) {
            return;
        }
    }
    $sender->Head->AddTag('meta', array('name' => 'robots', 'content' => 'noindex'));
}

hgtonight · June 2015

Huh, thought I had responded to this.

You need to check and make sure the discussion object exists. Replace line 3 with:

$discussion = val('Discussion', $sender, false);
if($discussion === false) {
  return;
}
$wordCount = str_word_count($discussion->Body);

You could also improve this by passing the bodies through the format class like @x00 did.

w1ckedsick · June 2015

Thanks, that worked!

I did also try @x00 code but my forum were just blank pages but I guess that doesn't matter now anyway.

w1ckedsick · July 2017

I've just upgraded from 2.1.x to 2.3.1 and this little hack/plugin is no longer working consistently.

Any ideas?

R_J · July 2017

Please provide the full code...

w1ckedsick · July 2017

$PluginInfo['TestingGround'] = array( // You put whatever you want to call your plugin folder as the key
    'Name' => 'Testing Ground', // User friendly name, this is what will show up on the garden plugins page
    'Description' => 'A skeleton plugin that adds its resources to every page, creates a settings page, and creates a stub minicontroller.', // This is also shown on the garden plugins page. Will be used as the first line of the description if uploaded to the official addons repository at vanillaforums.org/addons
    'Version' => '0.1', // Anything can go here, but it is suggested that you use some type of naming convention; will appear on the garden vanilla plugins page
    'RequiredApplications' => array('Vanilla' => '2.0.18.8'), // Can require multiple applications (e.g. Vanilla and Conversations)
    'RequiredTheme' => FALSE, // Any prerequisite themes
    'RequiredPlugins' => FALSE, // Any prerequisite plugins
    'MobileFriendly' => FALSE, // Should this plugin be run on mobile devices?
    'HasLocale' => TRUE, // Does this plugin have its own local file?
    'RegisterPermissions' => FALSE, // E.g. array('Plugins.TestingGround.Manage') will register this permissions automatically on enable
    'SettingsUrl' => '/settings/testingground', // A settings button linked to this URL will show up on the garden plugins page when enabled
    'SettingsPermission' => 'Garden.Settings.Manage', // The permissions required to visit the settings page. Garden.Settings.Manage is suggested.
    'Author' => 'Zachary Doll', // This will appear in the garden plugins page
    'AuthorEmail' => 'hgtonight@daklutz.com',
    'AuthorUrl' => 'http://www.daklutz.com',
    'License' => 'GPLv3' // Specify your license to prevent ambiguity
);

class TestingGround extends Gdn_Plugin {

    // add a Testing Ground page on the settings controller
    public function SettingsController_TestingGround_Create($Sender) {
        // add the admin side menu
        $Sender->AddSideMenu('settings/testingground');

        $Sender->Title($this->GetPluginName() . ' ' . T('Settings'));
        $Sender->Render($this->GetView('settings.php'));
    }

    public function PluginController_TestingGround_Create($Sender) {
        // Makes it act like a mini controller
        $this->Dispatch($Sender, $Sender->RequestArgs);
    }

    public function Controller_Index($Sender) {
        echo T('Plugins.TestingGround.SadTruth');
        echo "\nPlugin Index: " . $this->GetPluginIndex();
        echo "\nPlugin Folder: " . $this->GetPluginFolder();
    }

    public function Base_Render_Before($Sender) {
        $this->_AddResources($Sender);
        // decho($Sender)
    }

    private function _AddResources($Sender) {
        //$Sender->AddJsFile($this->GetResource('js/testingground.js', FALSE, FALSE));
        //$Sender->AddCssFile($this->GetResource('design/testingground.css', FALSE, FALSE));
    }

    public function Setup() {
        // SaveToConfig('Plugins.TestingGround.EnableAdvancedMode', TRUE);
    }

    public function OnDisable() {
        // RemoveFromConfig('Plugins.TestingGround.EnableAdvancedMode');
    }

    public function discussionController_render_before($sender) {
    $threshold = C('AutoNoIndex.Threshold', 300);
$discussion = val('Discussion', $sender, false); if($discussion === false) {   return; } $wordCount = str_word_count($discussion->Body);
    if($wordCount >= $threshold) {
        return;
    }
    $comments = $sender->Data('Comments', array());
    foreach($comments as $comment) {
        $wordCount += str_word_count($comment->Body);
        if($wordCount >= $threshold) {
            return;
        }
    }
    $sender->Head->AddTag('meta', array('name' => 'robots', 'content' => 'noindex, follow'));
}
}