Kitabe (Book in Hindi) is a Book Recommendation System built for all you Book Lovers
- Project Structure
- To Do
- Notebooks and Files
Our objective is to build an application for all Book Lovers
The Dataset that we used for this task is the goodbooks-10k dataset. It consists of 10k books with a total of 6 million ratings. That's huge right!
GoodBooks10k ├── books.csv # Contains book info with book-id ├── ratings.csv # Maps user-id to book-id and rating ├── book_tags.csv # Contains tag-id associated with book-ids ├── tags.csv # Contains tag-name associated with tag-id ├── to_read.csv # Contains book-ids marked as to-read by user
Since this is a recommendation problem, we have to make sure that the
books.csv is as clean as possible and only consider those ratings whose book-id is present, same goes for vice versa.
More Cleaning for
- Missing Book Image URLs
- Book & Rating Duplicates
For Recommendation Problems there are multiple approaches that are possible:
- Embedding Matrix
- Singular Matrix Decomposition
- Term Frequency
We experimented with several methods and chose Embedding Matrix & Term Frequency.
Embedding Matrix - This method is often called FunkSVD which won the Netflix Prize back in 2004. Since it is a gradient based function minimization approach we like to call it as Embedding Matrix. Calling it SVD confuses it with the one in Linear Algebra. This Embedding Matrix constructs a vector for each user and each book, such that when the product is applied with additional constraints it gives us the rating. For more elaborate info on FunkSVD refer this. We used the book embedding as a representation of the books to infer underlying patterns. This led to the embedding able to detect books from the same authors and also infer genres such as Fiction, Autobiography and more.
Term Frequency - This method is like a helper function to above, it shines where embedding fails. Term Frequency takes into account the tokens in a book title be it the book title itself, the name of authors and also rating. Taking into consideration it finds books which match closely with the tokens in the rated book.
🛠Code for every step can be found in the Notebooks and Files Section.
The Image says it All.
Kitabe │ ├───BookRecSystem # Main Project Directory │ ├───mainapp # Project Main App Directory │ │ │ └───migrations # Migrations │ ├───static | | # Static Directory │ └───mainapp │ ├───css # CSS Files | | │ ├───dataset # Dataset Files │ │ │ ├───gif # GIF Media │ │ │ ├───model_files # Model Files | | | │ │ ├───surprise # FunkSVD Files │ │ │ │ │ └───cv # CV Files │ │ │ └───png # PNG Media FIles | └───templates # Root Template DIrectory | ├───account # Account App Templates │ └───mainapp # Project Main App Templates
- Display Top Books Per Week
- Add AJAX View Tests
- Add Modal Tests
- Add User Read Feature
- Add User To Read Feature
- Use a Better Approach than Count Vectorizer
- Better Exhaustive Search For Hyperparameters
- Add User-User Similarity Recommendations
Notebooks and Files
- All Dataset & Model Files
- Cleaning and Embedding Notebook
- Fix Missing Images Notebook
- Genre Wise & Count Vectorizer Notebook
MIT License Copyright (c) 2020 Praful Mohanan & Prajakta Mane Permission is hereby granted, free of charge, to any person obtaining a copy of this software and associated documentation files (the "Software"), to deal in the Software without restriction, including without limitation the rights to use, copy, modify, merge, publish, distribute, sublicense, and/or sell copies of the Software, and to permit persons to whom the Software is furnished to do so, subject to the following conditions: The above copyright notice and this permission notice shall be included in all copies or substantial portions of the Software. THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE.