Homicide detectives have identified Benjamin Stiler as the Alleged Gunman wanted over a fatal shooting at a house party on the Victoria-New South Wales border.

Duwayne Johnson, 26, was shot in the chest at 3am on Sunday in Wodonga, on the Victorian side of the border.

A young single mum told Police about a dozen people were partying at a house in Woodland Street at the time of the shooting.

READ MORE: Victoria records 21,966 new COVID-19 cases and 15 deaths

Police said an argument broke out between Mr Johnson and Mr Stiler before the shooting occurred.

The alleged gunman then fled the scene in a light-coloured sedan, speeding off in an easterly direction, while neighbours ran out to try and save the 26-year-old father's life.

"All I have to say is why? He was just a young man with his life ahead of him," Mr Johnson's uncle told 9News.

READ MORE: Mother's partner charged with murder of nine-year-old Charlise Mutten

Police said Mr Stiler was likely still armed and known to frequent the Albury, Wodonga and Beechworth areas.

No arrests have been made.

Police are keen to speak to any witnesses or anyone with CCTV or dashcam footage.

Anyone with information should contact Crime Stoppers.