Invoke-WebRequest -URI https://google.com/favicon.ico -OutFile file.ico

A bit faster alternative with direct invokation of .NET classes

(New-Object System.Net.WebClient).DownloadFile("https://google.com/favicon.ico", "file.ico")