[Boards: 3 / a / aco / adv / an / asp / b / biz / c / cgl / ck / cm / co / d / diy / e / fa / fit / g / gd / gif / h / hc / his / hm / hr / i / ic / int / jp / k / lgbt / lit / m / mlp / mu / n / news / o / out / p / po / pol / qa / r / r9k / s / s4s / sci / soc / sp / t / tg / toy / trash / trv / tv / u / v / vg / vp / vr / w / wg / wsg / wsr / x / y ] [Home]
4chanarchives logo
I have a somewhat large (~5TB) pornography collection. I'd
Images are sometimes not shown due to bandwidth/network limitations. Refreshing the page usually helps.

You are currently reading a thread in /g/ - Technology

Thread replies: 32
Thread images: 4
File: database.png (130 KB, 1731x2400) Image search: [Google]
database.png
130 KB, 1731x2400
I have a somewhat large (~5TB) pornography collection.

I'd like to make a database with all the proper tags for easy location of content. I have experience with MySQL, but would PostgreSQL would be better for something like this? What about NoSQL?

I'm thinking about a table for each actress with the vendor ID (ie. AUKG-240) of the JAVs as the primary key, and then a separate table for tags that will be linked as a foreign key for each table. Is this a good idea?
>>
First step is admitting you have a problem.
>>
File: laughing whore.gif (134 KB, 340x340) Image search: [Google]
laughing whore.gif
134 KB, 340x340
>>55490991
>He doesn't have a large pornography folder.

How does it feel by having your masturbatory needs cucked by society?
>>
Surely vendor ID would not be unique, right?
>>
A good idea would be killing yourself.
>>
>>55491028
It is.
>>
Have fun destroying your intimate life and turning yourself into a lifeless zombie
>>
>>55490979
>5tb
>'somewhat large'
No motherfucker, that is excessive.
>>
>Not just putting it in the metadata
>>
>>55490979
>I'm thinking about a table for each actress with the vendor ID (ie. AUKG-240) of the JAVs as the primary key,
You're better off using an AUTO_INCREMENT field for your primary key.

>and then a separate table for tags that will be linked as a foreign key for each table
I should be a tags table and an intermediary jav_has_tag table containing a pair of (fk_tag, fk_jav) foreign keys since you're dealing with a many-to-many relationship here


As for noSQL, you could take a look at RethinkDB which is nice and create one document per JAV that you can modify however you want if you don't want to deal with having a strict schema.
You probably won't need a huge DB anyway, 5TB of jav is what? Less than 10k titles? Even sqlite would be powerful enough to manage that.
>>
>>55491081
It used to be much bigger.

>>55491136
Thank you for the serious answer.
AUTO_INCREMENT is basically just assigns a number to each row, right?
>>
>>55491063
>intimate life

... I don’t follow?
>>
>>55491026
How does it feel not getting laid?
>>
File: 1444534060008.png (41 KB, 1314x428) Image search: [Google]
1444534060008.png
41 KB, 1314x428
>>55491182
>AUTO_INCREMENT is basically just assigns a number to each row, right?
Right, and it should be unique (but this may depend on your database. RTFM)

Basically you want something like this to have an arbitrary number of tags and actresses assigned to your jav entries. I hope you like joins :^) (note that for the intermediary tables, the primary key is the fk pair)

t. EXPERT DATABASE DESIGNER (has designed over 300+ databases)
>>
You niggers step your game up and use javmoviescraper.jar
Scraped through 4tb of Jav
>>
>>55491284
>How does it feel not getting laid?

You sound like a beta orbiter that's butthurt at the fact someone masturbates or watches porn.
>>
>>55491345
>5TB
See >>55490991
>>
>>55491284

Indifferent and std free.
>>
>>55490979
This is an image database system that lets you view and tag images
https://github.com/r888888888/danbooru

This is an example of the database in action
https://danbooru.donmai.us/posts?tags=danboru
>>
>>55490979
Although it's 5TB of video, I really doubt it's that much in terms of metadata - probably a raspberry pi could handle all of it. Definitely not enough to consider NoSQL retardedness.

Have you thought of using a developed app for it like Plex? Probably what you want without too much effort.
>>
>>55491308
Thanks, anon.
I'm mostly just using as a learning experience.
>>
>>55491308
but... with NoSQL, you can just POST ye JSON.

{
"id": "JAV-007"
"vendor": "MYVENDOR",
"tags": [
"guro",
"gal"
]
}
>>
And i though my near 1TB was huge, you're on a completely different level, you should build a dedicated home porn server at that point maybe even make the jump to a SAN
>>
>>55491308
Do you have nice recommendations (books, tutorials) on DB design and development?
>>
>>55491587
Yes, but if you want to assign a tag to a jav for example then you have no guarantee that you didn't make a typo unless you have a separate table of allowed tags to manually compare your insertions to.
Also a well-structured SQL DB is much more convenient and safe to program things on top of, in my opinion.
I know this is nitpicking but I don't have anything in particular against NoSQL DBs that aren't mongo. Rethink is based.

>>55491656
No, I learned most of this in school.
I found this which looks pretty similar to what my courses looked like.
https://www.youtube.com/watch?v=tR_rOJPiEXc
>>
Why not just use this
https://www.tagspaces.org/
>>
>>55491810
I am not OP but thank you anon, this might come in handy.
>>
>>55491805
Yeah, but that's left to the application to make that validation before writing to the database. Users can also always accidentally create new tags as well.

At least in my experience, most customers never know what they actually want to it ends up being a waste of time spending all that time completely architecting your data model. Just implement something that works - or switch to a RDB later after you have a working prototype that the customer likes.
>>
File: 1440758209861.jpg (8 KB, 209x233) Image search: [Google]
1440758209861.jpg
8 KB, 209x233
>>55490979
>5TB of porno
>>
pretty sure this thread has appeared before.
>>
>>55490979
>>55491136
I think using the vendor ID as primary key was the right idea - the only reason it wouldn't work would be if there were videos without vendor IDs. Int auto_increment is just a good default when you don't want to put too much thought into it.

And yes, use sqlite
>>
>>55490979
>somewhat large
>5TB
Kek
Thread replies: 32
Thread images: 4

banner
banner
[Boards: 3 / a / aco / adv / an / asp / b / biz / c / cgl / ck / cm / co / d / diy / e / fa / fit / g / gd / gif / h / hc / his / hm / hr / i / ic / int / jp / k / lgbt / lit / m / mlp / mu / n / news / o / out / p / po / pol / qa / r / r9k / s / s4s / sci / soc / sp / t / tg / toy / trash / trv / tv / u / v / vg / vp / vr / w / wg / wsg / wsr / x / y] [Home]

All trademarks and copyrights on this page are owned by their respective parties. Images uploaded are the responsibility of the Poster. Comments are owned by the Poster.
If a post contains personal/copyrighted/illegal content you can contact me at [email protected] with that post and thread number and it will be removed as soon as possible.
DMCA Content Takedown via dmca.com
All images are hosted on imgur.com, send takedown notices to them.
This is a 4chan archive - all of the content originated from them. If you need IP information for a Poster - you need to contact them. This website shows only archived content.