Welcome!
Understanding Loss Functions, Backpropagation, and the PyTorch Transformer Understanding Loss Functions, Backpropagation, and the PyTorch Transformer
In the field of deep learning, loss functions and the backpropagation algorithm play a crucial role in training neural n
2023-06-22
Fast way to map an array X and array Y using nonparametric regression, a decision tree based regression Fast way to map an array X and array Y using nonparametric regression, a decision tree based regression
If want to find a a non linear relationship between two arrays, and it’s hard to model it using simple functions such as
2023-06-19
Utilizing Human Feedback for Enhanced Fine-Tuning of Large Language Models, RLHV vs finetuning difference Utilizing Human Feedback for Enhanced Fine-Tuning of Large Language Models, RLHV vs finetuning difference
Wonder what’s the difference between RLHF method with finetuning method? Fine-Tuning is actually the first step of a RL
2023-06-17
Constraining Prediction ranges in Deep Learning Regression Models Constraining Prediction ranges in Deep Learning Regression Models
Deep learning is widely used for various regression analysis tasks. However, sometimes we need to apply certain constrai
2023-06-16
New Function role added to GPT3.5 and GPT4 to give model to use API or functions as tools New Function role added to GPT3.5 and GPT4 to give model to use API or functions as tools
The latest update (June 2023) from OpenAI added a new role called function into their tool box.By describing functions i
2023-06-15
The short history of open source large language model from chatGPT so far The short history of open source large language model from chatGPT so far
Large language models (LLMs) have revolutionized the field of artificial intelligence, and their long-lasting impact is
2023-06-13
How critical is to normalize the input data, since there is layer normlization in the transformer encoder already How critical is to normalize the input data, since there is layer normlization in the transformer encoder already
Normalizing input data is generally a good practice, as it can improve the convergence rate and the overall performance
2023-06-11
Input dimension for pytorch transformer when the sequence length is one Input dimension for pytorch transformer when the sequence length is one
In pytorch, when we want to provide a 2-dimensional input with shape (batch_size, embedding_size), we should be careful
2023-06-11
A Comprehensive Guide to Binary, Multi-Class, and Multi-Label Classification A Comprehensive Guide to Binary, Multi-Class, and Multi-Label Classification
In this post, we are going to explore three important classification algorithms in the world of machine learning: binary
2023-06-09
Unlocking the Potential of ChatGPT and 9 Unique and Exciting Use Cases Unlocking the Potential of ChatGPT and 9 Unique and Exciting Use Cases
ChatGPT is an AI model that has the capacity to revolutionize the way we interact with technology. With its ability to u
2023-06-02
Demystifying the Black Box, Tools and Methods for Model Explainability in Machine Learning Demystifying the Black Box, Tools and Methods for Model Explainability in Machine Learning
Model explainability refers to the ability to understand and interpret the decisions made by machine learning models. It
2023-05-29
Understanding Squeeze and Unsqueeze in PyTorch Understanding Squeeze and Unsqueeze in PyTorch
When working with tensors in PyTorch, you may encounter situations where you need to modify the shape of your tensors by
2023-05-19
4 / 10