Coleraine meanwhile beat the DB Premiership champions Crusaders in a penalty shootout
Holders Cliftonville are out of the Northern Ireland League Cup on a dramatic night in the competition.
The winners for the past four years lost 3-2 after extra-time in their quarter-final against Glenavon at Mourneview Park.
Andy McGrory scored twice for the Lurgan Blues.
Coleraine beat Crusaders 5-4 in a penalty shoot-out at the Showgrounds.
Lyndon Kane hit the sudden death, spot kick winner after extra-time ended one-each.
The full-back had missed a decisive penalty against the Crues in a recent league game.
Ballymena United are also through after a 2-0 victory away to 10-man Warrenpoint Town.
The Championship club had Liam Bagnall sent off in the first half.
The other quarter-final tie also ended 2-0 - Carrick Rangers with a home win against Dungannon Swifts.
The draw for the semi-finals on December 13th will be made this Saturday.