LaxaeRipper (Command-line PHP Gallery Ripper)

[romuchix]

Hi Laxaeman

I just started to use your tool and it's really great. very smart code !

A few remarks if you allow me:

For the naming of the posts, some threads would be nice with the option of using the 1st line of text from each post to deduce the actual post title, coz the title itself if very often the same. For example:
Bad thread: https://vipergirls.to/threads/5706196-Jus...m-Collection
Good thread: https://vipergirls.to/threads/1553615-NuDolls-com-Collection
Otherwise I'll have to rename all of them manually

Also in case of 'bad thread', giving the option to have teh post ID in the post name would enable to distinguish them after batch download (and if desired avoid having the contents of several posts merged into one directory).

At least, when prompting for the post 'name' you could remind the index of that post.

I also would like to be able to pass ranges like 1-50 instead of 1,2,3,4,5,...,50 to rip posts 1 to 50

In the end, If I rip a thread with 150 posts I would prefer not having to be asked the title of each post synchronously (and the # of the start image) with the ripping operation, but rather do it afterwards once the ripping is done, provided that eitehr the title is meaningful OR the title easily refers to the thread post (ie include its title + ID for instance). Maybe a full thread rip option for instance.

OK that's all for now !

Thanks for this very interesting tool
Rx

[romuchix]

Hi Laxaeman,

I've used your tool with great success. I have a problem with hoster imx.to : it seems that it is not able to redirect to the proper picture URL. Traces show:

 .Ripper::processXml using ImxToHelper
ImxToHelper::process - https://imx.to/img-56d8cda2cfd9e.html
ImxToHelper::process we can derive the URI of the image from the thumbnail URI
RipperVipergirlsXml::getPage - looking for: 
using user_agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_3) AppleWebKit/537.75.14 (KHTML, like Gecko) Version/7.0.3 Safari/7046A194A
failed:

It seems that redirection resolves to nothing...
php check reports:

php check.php 
cURL is available on your computer!
You have at least PHP version 7.0.0, installed version: 7.3.19-1~deb10u1
pdo_sqlite is available on your computer!
sqlite is loaded
FYI the php.ini file used by the version of php you are using is located: /etc/php/7.3/cli/php.ini

And my configuration file is:

$conf = [
    'verbose' => true,
    'image_folder' => 'images/',
    'display_progress' => true,
    'display_progress_interval' => 1,
    'display_progress_character' => '.',
    'image_set_threshold' => 1,
    'prepend_increment' => false,
    'append_increment' => false,
    'log_downloads' => true,
    'username' => 'zorro',
    'password' => 'bernardo',
    'auto_like' => true,
    'clean_title' => true,

];

Example of a post that does not get ripped:
https://vipergirls.to/threads/1553615-NuDolls-com-Collection?p=13790959&viewfull=1#post13790959


Other hosts that I tried, like imgbox for example, are working great,

Is there anything to do to have it working ?

Thank !!
Rx

[alphomega]

I get the following error at the beginning.

Microsoft Windows [Version 6.3.9600]
(c) 2013 Microsoft Corporation. All rights reserved.

C:\Users\XXX>cd C:\Users\XXX\Downloads\laxaeripper-1.3.0

C:\Users\XXX\Downloads\laxaeripper-1.3.0>php rip.php

Fatal error: Uncaught PDOException: could not find driver in C:\Users\XXX\Downl
oads\laxaeripper-1.3.0\app\RipperSQLiteDb.php:29
Stack trace:
#0 C:\Users\XXX\Downloads\laxaeripper-1.3.0\app\RipperSQLiteDb.php(29): PDO->__
construct('sqlite:laxaerip...')
#1 C:\Users\XXX\Downloads\laxaeripper-1.3.0\app\RipperSQLiteDb.php(21): RipperS
QLiteDb->connect()
#2 C:\Users\XXX\Downloads\laxaeripper-1.3.0\rip.php(40): RipperSQLiteDb->__cons
truct()
#3 {main}
thrown in C:\Users\XXX\Downloads\laxaeripper-1.3.0\app\RipperSQLiteDb.php on
line 29

C:\Users\XXX\Downloads\laxaeripper-1.3.0>



My PHP version:

C:\PHP>php -v
PHP 8.0.10 (cli) (built: Aug 25 2021 08:42:00) ( NTS Visual C++ 2019 x86 )
Copyright (c) The PHP Group
Zend Engine v4.0.10, Copyright (c) Zend Technologies


Any suggestions?

[alphomega]

Also, does this ripper works fine with ImageBam host?

[jese]

PHP Fatal error: Uncaught Error: Call to undefined function curl_init() in /Downloads/laxaeripper-1.3.0/app/ViperGirls.php:40
Stack trace:
#0 /Downloads/laxaeripper-1.3.0/app/Ripper.php(501): ViperGirls->loginToSite()
#1 /Downloads/laxaeripper-1.3.0/app/rip_thread.php(13): Ripper->loginToSite()
#2 /Downloads/laxaeripper-1.3.0/rip.php(156): rip_thread()
#3 {main}
thrown in /Downloads/laxaeripper-1.3.0/app/ViperGirls.php on line 40


$ php check.php
cURL is not available on your computer which means LaxaeRipper will not work.
You have at least PHP version 7.0.0, installed version: 7.4.25
pdo_sqlite is available on your computer!
sqlite is loaded
FYI the php.ini file used by the version of php you are using is located: /etc/php/7.4/cli/php.ini


$ curl --version
curl 7.74.0 (x86_64-pc-linux-gnu) libcurl/7.74.0 OpenSSL/1.1.1k zlib/1.2.11 brotli/1.0.9 libidn2/2.3.0 libpsl/0.21.0 (+libidn2/2.3.0) libssh2/1.9.0 nghttp2/1.43.0 librtmp/2.3
Release-Date: 2020-12-09
Protocols: dict file ftp ftps gopher http https imap imaps ldap ldaps mqtt pop3 pop3s rtmp rtsp scp sftp smb smbs smtp smtps telnet tftp
Features: alt-svc AsynchDNS brotli GSS-API HTTP2 HTTPS-proxy IDN IPv6 Kerberos Largefile libz NTLM NTLM_WB PSL SPNEGO SSL TLS-SRP UnixSockets


Why am I getting this error?

[romuchix]

Hi there, you have curl commandline but you probably don't have the curl extension for PHP, the message is misleading.

run "php -zi curl" and it should start saying something like:

$ php --ri curl

curl

cURL support => enabled
cURL Information => 7.74.0
Age => 7
Features
AsynchDNS => Yes
CharConv => No
[...]

Otherwise, you may have to read the readme.html file and do some of what's in it.

On my system I have this ripper running very well.

Rx.

[jese]

Thank you @romuchix, I had another issue but was able to resolve it.

$ php check.php
cURL is available on your computer!
You have at least PHP version 7.0.0, installed version: 7.4.25
pdo_sqlite is available on your computer!
sqlite is loaded
FYI the php.ini file used by the version of php you are using is located: /etc/php/7.4/cli/php.ini 

PHP Fatal error:  Uncaught Error: Call to undefined function simplexml_load_string() in /home/Jese/Downloads/laxae1.3/app/rip_thread.php:35
Stack trace:
#0 /home/Jese/Downloads/laxae1.3/rip.php(156): rip_thread()
#1 {main}
  thrown in /home/Jese/Downloads/laxae1.3/app/rip_thread.php on line 35 

Thank you again

[yathink21]

If anyone is having recent issues, downgrading from php 7.4 to 7.3 worked for me.