The Template Override Guide for UpsellWP helps you customize the mini cart upsell display. The guide covers template overrides, customization option and best practices for a tailored upsell experience
This can be done by creating a simple override at your theme level.
NOTE: You will have to use an FTP client or the File Manager in your cPanel to carry out this change.