Author Topic: File renaming and processing with Tmux  (Read 738 times)

Offline theblade954

  • Junior Indexer
  • **
  • Posts: 8
  • Helpful: +0/-0
File renaming and processing with Tmux
« on: 2018-12-26, 02:09:03 pm »
Hello, i am kind of new with nzedb and i googled quite some time on this issue but i am experiancing some issues with the tools that are in nZEDb.
Because nZEDb when php start.php is beeing runned in folder /var/www/nZEDb/misc/update/nix/tmux/

I see that there are headers beeing downloaded into the database and published on the site but the file renaming and nfo adding are not beeing added to the site.
IRCscraper works well ( it downloads correctly everything from irc right into the predb ).

When i use /var/www/nZEDb/misc/update/nix/screen/sequential & ./simple.sh i see the following output...
Code: [Select]
Updating: 5 group(s) - Using compression? Yes [nzedb\Binaries::updateAllGroups]

Starting group 1 of 5 [nzedb\Binaries::updateAllGroups]

Processing alt.binaries.boneless

Part repair enabled. Checking for missing parts.

Group alt.binaries.boneless has 20,396 new articles. Leaving 10,198 for next pass.
Server oldest: 19,767,027 Server newest: 27,334,917,995 Local newest: 27,334,897,599


Getting 10,198 articles (27,334,897,600 to 27,334,907,797) from alt.binaries.boneless - (0 articles in queue).
Received 473KB from group (alt.binaries.boneless).
Received 10198 articles of 10,198 requested, 0 blacklisted, 147 not yEnc.
Debug: Sending 778.43 KB of MGR parts to MySQL
0.56s to download articles, 0.45s to process collections, 0.65s to insert binaries/parts, 0.00s for part repair, 1.66s total.

Group alt.binaries.boneless processed in 1.72 seconds.
...
Updating completed in 8.27 seconds. [nzedb\Binaries::updateAllGroups]

No work to do!
Process Releases -> Attempting to find complete collections.
0 collections were found to be complete. Time: 1 second(s)

Process Releases -> Calculating collection sizes (in bytes).
0 collections set to filecheck = 3(size calculated)
0 second(s)

Process Releases -> Delete collections smaller/larger than minimum size/file count from group/site setting.
Deleted 0 collections:
0 smaller than, 0 bigger than, 0 with less files than site/group settings in: 0 second(s)

Process Releases -> Create releases from complete collections.
0 Collections ready to be converted to releases.

0 Releases added and 0 duplicate collections deleted in 0 second(s)

Process Releases -> Create the NZB, delete collections/binaries/parts.
0 NZBs created/Collections deleted in 0 seconds.
Total time: 0 second(s)


Process Releases -> Delete finished collections.

Deleting collections/binaries/parts older than 72 hours.
Finished deleting 0 old collections/binaries/parts in 0 seconds.

Deleting collections that were missed after NZB creation.
Finished deleting 0 collections missed after NZB creation in 0 seconds.
Removed 0 parts/binaries/collection rows in 0 second(s)

Process Releases -> Delete releases smaller/larger than minimum size/file count from group/site setting.
Deleted 0 releases:
0 smaller than, 0 bigger than, 0 with less files than site/groups setting in: 0 second(s)

Process Releases -> Delete old releases and passworded releases.
Removed releases: 0 past retention, 0 passworded, 0 crossposted, 0 from disabled categories, 0 smaller than category settings, 0 from disabled music genres, 0 from misc->other0 from misc->hashed, 1 under 95% completion.
Removed 1 releases in 0 second(s)
Process Releases -> Request ID local lookup -- limit 0
No RequestID's to process.
0 releases updated in 0 second(s)

Process Releases -> Request ID web lookup -- limit 0
No RequestID's to process.
0 releases updated in 0 second(s)

Process Releases -> Categorize releases.
0 second(s)

Multi-processing for releases finished in 1.1662201881409 seconds at Wed, 26 Dec 2018 23:01:15 +0100.

No music releases to process.
No console releases to process.
No games releases to process.
No xxx releases to process.
No book releases to process for category id 7010

Decrypt Hashes (full) Started at 11:01:17
Matching predb hashes to hash(releases.name or releases.searchname)

2 releases to process.

Renamed 0 releases in 2 second(s).

Match PreFiles (150) Started at 11:01:19
Matching predb filename to cleaned release_files.name.


75 releases to process.

Renamed 0 releases in 0 second(s).
waiting 60 seconds...
U

The releases to process number will get every instance higher and not lower.

And no files will be renamed and also no mediainfo will be added. :-(

Is there someone who can help me with this issue..
i am kind of N00B around here ;-) sorry

Offline theblade954

  • Junior Indexer
  • **
  • Posts: 8
  • Helpful: +0/-0
Re: File renaming and processing with Tmux
« Reply #1 on: 2018-12-27, 12:48:13 am »
i also tried the following option it was provided by Wally73

cd misc/update/nix/screen/sequential/ && screen sh simple-expanded.sh

now i see that there sometimes a NFO will be added or a list of the files which the rar files contain. But the renaming will not be done..
is there something i might quite have looked over or missed?
Are there some other additional add-ons better for nZEDb ?

Offline Wally73

  • Overlord
  • ******
  • Posts: 266
  • Helpful: +31/-1
  • i'm nuts
Re: File renaming and processing with Tmux
« Reply #2 on: 2018-12-27, 01:59:54 am »
stop thinking all stuff will be renamed (IT WON'T )

further under admin/site-edit.php
3rd Party Application Paths set the right paths to mediainfo, ffmpeg/avconv, unrar (make sure your version is above v5.xx

under Post Process Settings
enable the following for sure
lookup par2
Add PAR2 contents to file contents
Lookup Movies (all)
Lookup TV (all)

Post Process Additional Settings - Rar/ZIP file processing

Check For Passworded Releases: deep

Offline theblade954

  • Junior Indexer
  • **
  • Posts: 8
  • Helpful: +0/-0
Re: File renaming and processing with Tmux
« Reply #3 on: 2018-12-27, 02:58:04 am »
Thanks Wally73 , sorry for thinking that all the files can be renamed.
I came because i saw this at this site https://abnzb.com/ everything is beeing renamed and placed in the correct catogory. i have investigated that that site is running on newznab ( is newznab better than nZEDb? )

I have added your recommends into my site.

i am going to have a test.
i will let you now if the processing goes better now.

Offline theblade954

  • Junior Indexer
  • **
  • Posts: 8
  • Helpful: +0/-0
Re: File renaming and processing with Tmux
« Reply #4 on: 2018-12-27, 03:21:02 am »
i am currently recieving the following error in the screen list

Code: [Select]
[1365][1.3GB](cB)r(cB)rPHP Warning:  simplexml_load_string(): Entity: line 1: parser error : Start tag expected, '<' not found in /var/www/nZEDb/libraries/mhor/php-mediainfo/src/Parser/AbstractXmlOutputParser.php on line 18
PHP Warning:  simplexml_load_string(): General in /var/www/nZEDb/libraries/mhor/php-mediainfo/src/Parser/AbstractXmlOutputParser.php on line 18
PHP Warning:  simplexml_load_string(): ^ in /var/www/nZEDb/libraries/mhor/php-mediainfo/src/Parser/AbstractXmlOutputParser.php on line 18
PHP Warning:  array_key_exists() expects parameter 2 to be array, boolean given in /var/www/nZEDb/libraries/mhor/php-mediainfo/src/Parser/MediaInfoOutputParser.php on line 40
PHP Warning:  Invalid argument supplied for foreach() in /var/www/nZEDb/libraries/mhor/php-mediainfo/src/Parser/MediaInfoOutputParser.php on line 46


Offline Darius

  • Enforcer
  • *****
  • Posts: 121
  • Helpful: +8/-1
Re: File renaming and processing with Tmux
« Reply #5 on: 2018-12-27, 01:36:13 pm »
Thanks Wally73 , sorry for thinking that all the files can be renamed.
I came because i saw this at this site https://abnzb.com/ everything is beeing renamed and placed in the correct catogory. i have investigated that that site is running on newznab ( is newznab better than nZEDb? )

I have added your recommends into my site.

i am going to have a test.
i will let you now if the processing goes better now.

abnzb does a lot of work to have those releases renamed, it is not just newznab code. Same goes for any indexer that does better than majority. Good indexers do not rely only on provided code by software they use, they invest lot of time and effort to catch and rename releases.
Running an indexer, especially now with high level of obfuscation, is not a trivial thing to do.

Offline theblade954

  • Junior Indexer
  • **
  • Posts: 8
  • Helpful: +0/-0
Re: File renaming and processing with Tmux
« Reply #6 on: 2018-12-28, 01:12:26 am »
Thanks Wally73 , sorry for thinking that all the files can be renamed.
I came because i saw this at this site https://abnzb.com/ everything is beeing renamed and placed in the correct catogory. i have investigated that that site is running on newznab ( is newznab better than nZEDb? )

I have added your recommends into my site.

i am going to have a test.
i will let you now if the processing goes better now.

abnzb does a lot of work to have those releases renamed, it is not just newznab code. Same goes for any indexer that does better than majority. Good indexers do not rely only on provided code by software they use, they invest lot of time and effort to catch and rename releases.
Running an indexer, especially now with high level of obfuscation, is not a trivial thing to do.

Darius thanks for your reply... the indexing works and renaming and adding images and screenshots. thanks to Wally73 his settings :-)

The only error i recieve is when the ffmpeg runs his code...
This is the error code i recieve
Code: [Select]
PHP Fatal error:  Uncaught TypeError: Argument 1 passed to nzedb\NameFixer::nzedb\{closure}() must be of the type string, null given, called in /var/www/nZEDb/nzedb/NameFixer.php on line 929 and defined in /var/www/nZEDb/nzedb/NameFixer.php:915
Stack trace:
#0 /var/www/nZEDb/nzedb/NameFixer.php(929): nzedb\NameFixer->nzedb\{closure}(NULL)
#1 /var/www/nZEDb/nzedb/NameFixer.php(877): nzedb\NameFixer->matchPredbFiles(Array, 1, 1, true, 1)
#2 /var/www/nZEDb/misc/update/match_prefiles.php(22): nzedb\NameFixer->getPreFileNames(Array)
#3 {main}
  thrown in /var/www/nZEDb/nzedb/NameFixer.php on line 915

What is causing the problem ?

Offline sinistra

  • Decent Indexer
  • ***
  • Posts: 84
  • Helpful: +2/-0
Re: File renaming and processing with Tmux
« Reply #7 on: 2019-01-01, 08:16:12 am »
Thanks Wally73 , sorry for thinking that all the files can be renamed.
I came because i saw this at this site https://abnzb.com/ everything is beeing renamed and placed in the correct catogory. i have investigated that that site is running on newznab ( is newznab better than nZEDb? )

I have added your recommends into my site.

i am going to have a test.
i will let you now if the processing goes better now.

abnzb does a lot of work to have those releases renamed, it is not just newznab code. Same goes for any indexer that does better than majority. Good indexers do not rely only on provided code by software they use, they invest lot of time and effort to catch and rename releases.
Running an indexer, especially now with high level of obfuscation, is not a trivial thing to do.

Darius thanks for your reply... the indexing works and renaming and adding images and screenshots. thanks to Wally73 his settings :-)

The only error i recieve is when the ffmpeg runs his code...
This is the error code i recieve
Code: [Select]
PHP Fatal error:  Uncaught TypeError: Argument 1 passed to nzedb\NameFixer::nzedb\{closure}() must be of the type string, null given, called in /var/www/nZEDb/nzedb/NameFixer.php on line 929 and defined in /var/www/nZEDb/nzedb/NameFixer.php:915
Stack trace:
#0 /var/www/nZEDb/nzedb/NameFixer.php(929): nzedb\NameFixer->nzedb\{closure}(NULL)
#1 /var/www/nZEDb/nzedb/NameFixer.php(877): nzedb\NameFixer->matchPredbFiles(Array, 1, 1, true, 1)
#2 /var/www/nZEDb/misc/update/match_prefiles.php(22): nzedb\NameFixer->getPreFileNames(Array)
#3 {main}
  thrown in /var/www/nZEDb/nzedb/NameFixer.php on line 915

What is causing the problem ?

There's a fix here.

https://github.com/nZEDb/nZEDb/issues/2607