Utilizing computer vision, AI technology for visual jobsite tasks

Artificial intelligence is causing a stir in most industries, and construction is no different. Using smartphones or pole-mounted cameras, a computer application can acquire important information from videos or images, and complete a task based on the information garnered. This technological solution is called computer vision.

Whether a teenager applies filters on Snapchat or a driver uses an automatic parking system, many people already use computer vision on a regular basis.

Although this technology has been around a few years, its application on construction sites is rather nascent. Most engineering and construction companies are not using the full capabilities of computer vision. This technological solution has the potential to improve construction management and project execution by facilitating safer work practices and automating construction progress measurement and quality control.

Technology for a Safer Job Site

On a construction site, safety is top concern for the site manager and the crew, as construction is inherently riskier than many occupations. According to the U.S. Bureau of Labor Statistics, for every 10,000 private sector employees there were 21.7 nonfatal injuries or illnesses that required days off in 2020. For every 10,000 construction employees the rate of nonfatal injuries or illnesses requiring days off was 31.4—nearly 50% higher than all private sector jobs combined.

Using computer vision, site managers could more easily identify safety violations or risky activity on a job site. Cameras mounted on poles throughout the construction site can serve images to an application trained to look for safety violations or risky behavior. For example, if the application can recognize when an employee is wearing proper personal protective equipment, the site manager will be notified if an employee fails to wear a hard hat on-site.

These new solutions aren’t intended to punish construction crews, but instead create situational awareness so management can promote safe work habits.

Tracking Project Progress

If time is limited for project execution, finding efficiencies is critical for meeting client expectations. Instead of requiring humans to walk through a site checking for progress each day, computer vision can help construction crews track site progress. Programming a computer vision application to identify specific items, such as a solar panel or lattice tower, could give site and construction managers a quick count of the installed materials on a project site.

For example, if a drone or smartphone can take a picture of a field where solar panels are installed and send the picture through a computer vision application, the application could quickly count how many solar panels are installed and how many are remaining, eliminating the need for a crew member to walk through the field counting each panel and measuring site progress.

Computer Vision Eliminating Defects and Maintaining Quality

Maintaining structural integrity is critical for successfully executing a construction project. Using a computer vision application, a construction manager or crew member could diagnose whether an entire concrete foundation is level or if planned piping or other features are correctly located. Using this technology after concrete is poured but before building commences could minimize concerns about structural integrity, especially if the foundation needs to be adjusted.

In another example, a municipality, or utility company that wants to see how many defective lightbulbs are on the roadway could cut staff time down by using video or pictures of the streetlights. If the computer vision application received a video and was configured to identify defective streetlights, crews could fix the light immediately, rather than waiting for a complaint from a driver or sending staff out to see if all lights are operational.

Many of the examples provided are hypothetical but this technology has already demonstrated its effectiveness in consumer applications. Potential concerns regarding this technology arise when considering privacy rights for construction crew members, especially subcontractors and union crews who may feel uncomfortable if cameras are installed across a construction site without explanation of the benefits, intent and agreed-upon usage restrictions.

Being clear about the intended use of cameras and computer vision is important for assuaging these concerns. A crew member who has a doctor’s appointment before arriving to work may not appreciate feeling like he or she is being monitored for timeliness. Also, before a crew member demonstrates risky behavior on the work site that is identified by the computer vision application, it’s important to have clear policies and procedures established and clearly communicated to the construction crew. Computer vision is simply one more tool to build and reinforce a strong safety culture.

Computer vision applications can’t do the hands-on work required at a construction site, but for tasks that require visual inspection—safety, quality control and project progress—this technological solution has the potential to create efficiencies and reduce manual work.