Tool you are using to hold the bullet connector it looks like it’s made of metal and has a very good thermal connection to the bullet.
This will suck heat away very effectively leading to the result you took a photo of.
See if you could somehow hold that bullet in place with something that has less thermal conductivity/ thermal mass