In simple words, Avatar is the profile picture of a user on your website. WordPress uses Gravatar image as the user’s default Avatar.
You can also use a plugin to let your users upload their avatar from wp-admin profile section instead of using gravatar.
Also read: Complete WordPress Glossary