Grounding language to vision

Project description

There is increasing interest in problem of grounding language to vision, in particular video, i.e. to build a system which is able to determine objects, object properties, or activities, words or phrases in language correspond to. 

This project will build on existing work at Leeds on this problem, which shows how it is possible to ground loosely aligned short clips with simple textual descriptions, and to learn a grammar corresponding to the textual input, but will aim to extend it in several directions; one such direction is enable longer video clips and longer textual descriptions to be handled; another is to allow more complex objects and object descriptions, as well as more complex activity descriptions. Another possible avenue of exploration is allow the incorporation of existing world knowledge, as is extension to other modalities apart from vision, e.g. touch or sounds.

Entry requirements

Applications are invited from candidates with a minimum of a UK upper second class honours degree (2:1), and/ or a Master's degree in a relevant subject. We also recognise relevant industrial and academic experience.

How to apply

Formal applications for research degree study should be made online through the university's website. Please state clearly in the research information section of your application, the name of the PhD you wish to apply for is 'Grounding language to vision' as well as Professor Anthony Cohn as your proposed supervisor. In the funding section, please state 'School of Computing Funded Studentships' as your sponsor.

If English is not your first language, you must provide evidence that you meet the University’s minimum English Language requirements.

We welcome scholarship applications from all suitably-qualified candidates, but UK black and minority ethnic (BME) researchers are currently under-represented in our Postgraduate Research community, and we would therefore particularly encourage applications from UK BME candidates.  All scholarships will be awarded on the basis of merit.

If you require any further information please contact the Graduate School Office
e:, t: +44 (0)113 343 8000.