No Partying Mariachis

    fb-extract

    0.0.2 • Public • Published

    Tool for extracting information out of facebook.zip

    Facebook appearently allows you to download your data in a .zip-file (try it here). Sadly, the files are in HTML and are meant to be viewed in a web browser; the raw data is hard to consume. Then, this repository happened.

    fb-extract is a CLI that extracts your facebook data (messages) from HTML into JSON/CSV. Using this tool, you get the power to do whatever you want with your precious data. Word completetion, a chatbot that uses your expressions, machine learning etc. Endless possibilities! With your own data! Yay!

    Anyhow, my conversion is probably not perfect. If you feel like something is lost in the conversion, file up an issue.

    These platforms/databases/languages are tested so far:

    • Linux/PostgreSQL/Swedish

    I have no idea if this tool works at all with any language other than Swedish, and I have currently no way of testing that. As such, PR are very welcome :)

    NOTE! Your language has to be in this repository to convert timestamps correctly. The timestamps looks like "den 10 november 2013 kl. 10:18 UTC+01" and are thus impossible to convert without a locale. If your language isn't supported, timestamps will be recorded as null.

    Installation

    npm i -g fb-extract

    Usage

    Unzip facebook.zip that you downloaded from here, then run fb-extract /path/to/facebook_dir.

    The tool will now ask you for your language the first time you run it. This is to make sure that timestamps are converted properly. The config is stored in ~/.config/fb-extract-nodejs/config.json. If interrupted, the tool restarts at where it left off by scanning the JSON-dir.

    Converting long conversations takes quite a long time compared to short ones. Go ahead and take a coffee or two.

    The tool creates two new folders in /path/to/facebook_dir

    .
    ├── csv
    └── json
    

    where files are placed accordingly.

    If you wan't to play around with TensorFlow, you're all set. Just use the csv-files.

    If you wan't to have your messages in your database however, you should run psql < csv/import.sql (or execute csv/import.sql in some way on your database)

    Tables

    Columns in italics indicate a foreign key referencing another table key.

    chats

    Column Type
    cid serial
    chat_name text

    messages

    Column Type
    mid serial
    cid integer
    uid integer
    content text
    media text
    timestamp timestamp without time zone

    participants

    Column Type
    pid serial
    uid integer
    cid integer

    users

    Column Type
    uid serial
    name text

    reactions

    Column Type
    rid serial
    mid integer
    uid integer
    emoji integer

    Example queries

    Found under examples/

    License

    MIT

    Install

    npm i fb-extract

    DownloadsWeekly Downloads

    3

    Version

    0.0.2

    License

    MIT

    Unpacked Size

    16.6 kB

    Total Files

    7

    Last publish

    Collaborators

    • mryakobo