Skip to content
This repository has been archived by the owner on Jan 31, 2024. It is now read-only.

Can you add module for purchase content #12

Closed
smallworl opened this issue Feb 10, 2022 · 9 comments
Closed

Can you add module for purchase content #12

smallworl opened this issue Feb 10, 2022 · 9 comments
Labels
added feature Feature has been added

Comments

@smallworl
Copy link

i would like to download my purchase content if possible the url is below thank you
https://fansly.com/collection

thanks in advanced

@Avnsx Avnsx added help wanted Extra attention is needed contributors appreciated help adding this functionality/feature labels Feb 12, 2022
@Avnsx Avnsx added the wanted feature a interesting feature someone requested label May 8, 2022
@blunderedbishop
Copy link

Wouldn't it be enough to make a log-in request and the run the script with the acquired cookies? Sorry but i don't have any paid content to test this with.

@Avnsx
Copy link
Owner

Avnsx commented Oct 13, 2022

No my code does not support purchased (/collection) content. The reason it doesn't is, because I'm not planning to pay for nsfw content ever, so I can't ever add this 🤷‍♂️

If anyone really wants fansly scraper to have purchased content supported; send fansly account credentials with username & password with access to any purchased content to AvnDev[at]protonmail[dot]com

@Litvan
Copy link

Litvan commented Oct 20, 2022

What about pictures in private messages?

@Avnsx
Copy link
Owner

Avnsx commented Oct 21, 2022

What about pictures in private messages?

Already supported

@Litvan
Copy link

Litvan commented Oct 21, 2022

What about pictures in private messages?

Already supported

well last I used it, it didn't scrape anything from the specific creator that I had in my DM's from that person

@Nostang3
Copy link

I can confirm it still doesn't scrap my purchase content from my DM's.

@Photofreak
Copy link

I am unable to load purchases content from Fansly in the DM/Chat.

@Avnsx
Copy link
Owner

Avnsx commented May 8, 2023

Hey thanks to one of you guys DM'ing me a fansly account I could add the support for collections & single posts.

After you download the new fansly_scraper.py & config.ini files manually, you'll be able to configure a download_mode option in config.ini. This option allows you to set it to:
"Single "-> if you set it on single, once you launch the scraper it will ask you what post by id, you want to download
"Collection" -> adds support for collections, you launch the scraper it just downloads everything you ever paid for

None of these options support hashing or update_recent_download at the moment. I am planning to add that in a whole re-write of fansly scraper, later on.

You can currently only use it through the python version of fansly scraper, the compability was added in commit: b30a65d

If anyone knows how to set the python version up properly, let me know if you think that these options are a good implementation or not.

Will release a compiled release later this week

Avnsx added a commit that referenced this issue May 21, 2023
- rewrote major parts of the codebase
- rebranded to Fansly Downloader
- additonal module requirements: json, m3u8, av, time, mimetypes
    - from which only: m3u8 & av need to be installed
- option naming_convention is now deprecated & gets removed automatically
- re-named all major variables, to be more descriptive
- now reading value types, properly out of the config.ini file
- config.ini input values are now actually being validated for correctness
    - e.g. user-agent is automatically guessed now, if invalid
- update_recent_download has been improved drastically
    - now only supports Auto or False
    - its enabled by default now
    - it will be way quicker, by utilising deduplication
    - deduplication is done through 1. media id & 2. hashing now
    - hashes are added to filenames initially
    - filenames with hashes, will not get hashed again
- epoch timestamps are now converted into local systems timezone
- added alot of comments to codebase, for easier understanding
- CWD is now way more intelligently handled for all modules utilising generate_base_dir()
- added type annotations to function arguments for functions
- adapted fansly scraper for the new m3u8 video format
    - required: pyav -> pip install av
    - required: m3u8 -> pip intall m3u8
- added DUPLICATE_THRESHOLD; prevents unnecessary computation or requests to fansly
    - raises DuplicateCountError if dynamically calculated limit is exceeded
- all "modules" (Timeline, Messages etc.) are now tunneled through sort_download()
    - sort_download is a re-written version of the old namesaked function
    - it handles allocating downloads way more efficiently
    - adds media ids to filenames initially
    - if media ids are in filenames; uses them to perform deduplication with media id
    - supports all types of file extensions & mimetypes now
    - imagehash performance improved, by resizing image to 10% of original resolution b4
- all "modules" will now utilise parse_media_info() to interact with the fansly api
    - way more efficent; it doesn't just iterate & try / except blocks everything as b4
- all functions of fansly scraper are separated in modules / sections w/e
    - improves maintenance in the future & increases human readability
- re-wrote & improved logic for timeline & messages downloads
- added module for collections (#12)
- fansly downloader will now output more descriptive texts, to the currently taken action
- improved error robustness a little, need to more in the future though

fixed issues:
- fixed a issue with not escaping apostrophes on macOS (#78)
- fixed subscriber content missing (#59)
- all media file extensions are now supported (#75)
- fixed download_mode: single
    - fixed key-pair-id missing
    - fixed incorrect parsing of post creator
@Avnsx Avnsx added solved added feature Feature has been added and removed contributors appreciated help adding this functionality/feature help wanted Extra attention is needed wanted feature a interesting feature someone requested solved labels May 21, 2023
@Avnsx
Copy link
Owner

Avnsx commented Jun 12, 2023

Closing, as the 0.4 version is finally released and does target & solve the topics mentioned within this issue.

If you're on the previous 0.3.5 version you can comfortably update using the updater.exe supplied in the version, or just manually download the 0.4 version from the repositories Releases.

@Avnsx Avnsx closed this as completed Jun 12, 2023
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
added feature Feature has been added
Projects
None yet
Development

No branches or pull requests

6 participants