Author Topic: predb daily imports  (Read 2132 times)

Offline goin3d

  • Junior Indexer
  • **
  • Posts: 7
  • Helpful: +0/-0
predb daily imports
« on: 2017-08-13, 05:16:48 am »
Did a first time install over the weekend and most everything seems to be processing well (thanks to a lot of the posts and docs here!).  In terms of populating the preDB data the ircscrapper is running but I'm trying to catch the data up via "php predb_import_daily_batch.php 0 local true". when entering the command the cursor simply goes to the next line without any output.  Due to some of the other posts a couple months ago, grabbed the latest version of the php file from the site, but to no avail.  Could anyone point me in the right direction to diagnose this one?  I'm also struggling to find the appropriate logs to check. :'(
« Last Edit: 2017-08-13, 11:42:49 pm by Wally73 »

Offline SpicyRichter

  • Junior Indexer
  • **
  • Posts: 9
  • Helpful: +0/-0
Re: prefab daily imports
« Reply #1 on: 2017-08-13, 11:35:15 pm »
I actually ran into this today too. Puzzling because I had the script running a couple of days ago.
Turning on the debugging results in:
Code: [Select]
Checking resource path
Checking directory is writable
Parameter check completed
Fetching predb_dump list from GitHub
Extracting filenames from list.
^https://raw.githubusercontent.com/nZEDb/nZEDbPre_Dumps/master/dumps/(?P<filename>(?P<stamp>\d+)_predb_dump\.csv\.gz)$
 https://raw.githubusercontent.com/nZEDb/nZEDbPre_Dumps/master/dumps/0README.txt
^https://raw.githubusercontent.com/nZEDb/nZEDbPre_Dumps/master/dumps/(?P<filename>(?P<stamp>\d+)_predb_dump\.csv\.gz)$

^https://raw.githubusercontent.com/nZEDb/nZEDbPre_Dumps/master/dumps/(?P<filename>(?P<stamp>\d+)_predb_dump\.csv\.gz)$

^https://raw.githubusercontent.com/nZEDb/nZEDbPre_Dumps/master/dumps/(?P<filename>(?P<stamp>\d+)_predb_dump\.csv\.gz)$

^https://raw.githubusercontent.com/nZEDb/nZEDbPre_Dumps/master/dumps/(?P<filename>(?P<stamp>\d+)_predb_dump\.csv\.gz)$

Offline Wally73

  • Overlord
  • ******
  • Posts: 269
  • Helpful: +31/-1
  • i'm nuts
Re: prefab daily imports
« Reply #2 on: 2017-08-13, 11:42:29 pm »
works fine on my end

check php error logs

Offline SpicyRichter

  • Junior Indexer
  • **
  • Posts: 9
  • Helpful: +0/-0
Re: predb daily imports
« Reply #3 on: 2017-08-13, 11:58:39 pm »
It's not throwing any PHP errors, just the above output when debugging is turned on.

Offline goin3d

  • Junior Indexer
  • **
  • Posts: 7
  • Helpful: +0/-0
Re: predb daily imports
« Reply #4 on: 2017-08-14, 03:42:16 am »
Code: [Select]
[14-Aug-2017 06:38:06 America/New_York] PHP Warning:  require_once(/var/www/nzedb/cli/data): failed to open stream: No such file or directory in /var/www/nzedb/cli/data/predb_import_daily_batch.php on line 25
[14-Aug-2017 06:38:06 America/New_York] PHP Fatal error:  require_once(): Failed opening required '' (include_path='.:/usr/share/php:/usr/share/pear') in /var/www/nzedb/cli/data/predb_import_daily_batch.php on line 25

This is what i can see in the log

it looks like that applies to:
Code: [Select]
require_once realpath(dirname(dirname(__DIR__)) . DIRECTORY_SEPARATOR . 'bootstrap.php');

« Last Edit: 2017-08-14, 03:45:02 am by goin3d »

Offline SpicyRichter

  • Junior Indexer
  • **
  • Posts: 9
  • Helpful: +0/-0
Re: predb daily imports
« Reply #5 on: 2017-08-14, 11:56:18 am »
My line 25 reads:

Code: [Select]
require_once realpath(dirname(dirname(__DIR__)) . DIRECTORY_SEPARATOR . 'indexer.php');

Offline goin3d

  • Junior Indexer
  • **
  • Posts: 7
  • Helpful: +0/-0
Re: predb daily imports
« Reply #6 on: 2017-08-14, 06:26:29 pm »
Thanks!!! that did the trick, but i cannot figure for the life of me why that one file would be different in my new install that's just a few days old! 

Offline SpicyRichter

  • Junior Indexer
  • **
  • Posts: 9
  • Helpful: +0/-0
Re: predb daily imports
« Reply #7 on: 2017-08-15, 02:16:44 pm »
It turns out you and I are running an outdated version? My issues were solved by getting the latest from git

The install you are using is likely from the composer checkout? I think that's how I ended up with this version