Stop writing a few hundred log lines per request
Every neighbourhood request printed one line per window position, one per
vocabulary lookup, the whole JSON of a similar profile and the comings and
goings of the worker threads. Together with the crawler traffic that came
to about a million lines a day on corpora.ids-mannheim.de, which is what
filled the log partition of the machine.
Those diagnostics are behind DEREKOVECS_DEBUG now, and the per request
narration of the perl side, which repeated what the access log line of the
same request already says, is logged at debug level. What is left in the
default configuration is one line per request, plus the user agent of a
request that was turned away as a crawler.
Startup messages, the model mapping and error messages are untouched.
Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
Change-Id: I4059a1db5ba59a59da6177225c6f66ff53ddcaec
diff --git a/lib/IDS/DeReKoVecs/Read.pm b/lib/IDS/DeReKoVecs/Read.pm
index f75ca90..0b396ec 100644
--- a/lib/IDS/DeReKoVecs/Read.pm
+++ b/lib/IDS/DeReKoVecs/Read.pm
@@ -89,19 +89,19 @@
my $pipe;
if($compare_to ne "") {
- $c->app->log->info("comparing syn neighbours to: $compare_to/getClassicCollocators?w=$word");
+ $c->app->log->debug("comparing syn neighbours to: $compare_to/getClassicCollocators?w=$word");
open $pipe, "lwp-request $compare_to/getClassicCollocators?w=$word |";
}
my $collocators = $opt_C ? undef : $cccache->get($word);
if(!defined $collocators) {
- $c->app->log->info("Getting classic collocates of $word.");
+ $c->app->log->debug("Getting classic collocates of $word.");
$collocators = getClassicCollocators($word);
$collocators =~ s/:(-?)(nan|inf)/:"${1}${2}"/g;
$collocators =~ s/"""/"\\""/g;
$cccache->set($word => $collocators) unless $opt_C;
} else {
- $c->app->log->info("Getting classic collocates for $word from cache.");
+ $c->app->log->debug("Getting classic collocates for $word from cache.");
}
if(defined($pipe)) {
@@ -145,7 +145,7 @@
$profiles = getSimilarProfiles($word);
$spcache->set($word => $profiles) unless $opt_C;
} else {
- $c->app->log->info("Getting similar profiles for $word from cache:");
+ $c->app->log->debug("Getting similar profiles for $word from cache:");
}
return $profiles;
}