Here are six ways CAD and 3D printing have come together to drive healthcare forward. Only a few short decades ago, some of these results seemed would have been considered “science fiction.”

Jean Thilmany, Senior Editor

Twenty-five years ago, it became possible to turn a computed tomography (CT) scan or an X-ray into a three-dimensional, handheld medical model that would exactly match a patient’s anatomy. Surgeons could order one of these models from a third-party provider by sending in patient images and getting a handheld model—shaped by human hands from a variety of materials—back within a few weeks.

The widespread advent of 3D printing soon made the sending and the shaping obsolete. Now, doctors who print their individualized medical images have 3-D models in their hands in hours, even in moments, depending on where the printer is located.

That’s one example of the ways engineering technology—including computer-aided modeling and 3D printing—has made hugely helpful strides into the medical field within the past few decades.

And the use of CAD modeling software within medicine continues to evolve even as it becomes more widely adopted within varied medical and biomedical settings. Below, we take a look at the ways CAD continues to make inroads into the healthcare industry.

Surgery guide
Because every patient is different, each surgery differs too, no matter how slightly. For decades in the medical world, surgeons and their professional support teams relied on X-rays, computed tomography (CT) scans and magnetic resonant imaging (MRI) data to plan a patient’s surgery exactly.

Doctors used these guides to study and practice the techniques called upon for that patient’s particular surgery.

But the resolution and 2D perspective of these images could make it difficult to determine the full details of an anatomical geometry. “Subtle abnormalities or hidden geometries can go unnoticed on these flat films,” says Derek Steinbacher former director of craniofacial surgery at Yale New Haven Hospital.

This year, Steinbacher was named the Yale School of Medicine’s medical director for innovation and emerging technologies. In naming the promotion, the school’s directors praised Steinbacher’s use of artificial intelligence and 3D planning for complex and routine facial plastic surgeries.

Today, models of specific patient’s anatomy are often printed in 3D, thanks to the linkage of CAD and 3D printers. The specialized software turns the 2D medical image of the organ, bone, or other part of body into a 3D CAD model that can then be printed, notes Steinbacher.

“Thanks to virtual reality manipulation technology that 3D imaging offers, surgeons are able to plan a surgery using guides and jigs, which are later used during surgery to provide the surgeon with a precise cutting path or accurate drill angles. In many cases, surgeons evaluate several different scenarios long before making an incision,” says Lisa Lattanza, an orthopaedic surgeon at the Yale School of Medicine.

Using this technology, Lattanza, is able to detect indicators for deformity after trauma or congenital deformities. Bilateral 3D renderings are generated from scans that reveal the patient’s skeletal anatomy. Those mirrored images are laid on top on one another, which allow Lattanza to directly compare and evaluate bone topography and deformity in three planes and allow for exact correction as well as to better identify locations for drill guides, cuts, and screws that may be needed.

“This type of technology allows me to perform types of operations I would otherwise be unable to perform or at least could not perform with as much accuracy,” Lattanza says.

The technique has been shown to save time during the operation itself.

A paper in the August 2020 issue of the journal Academic Radiology found that using 3D printed anatomic models in surgical care could cut anywhere from 23 minutes to one hour from the operation itself and cut cost surgical costs by up to $3,720, according to lead author David Ballard, assistant professor of radiology at the Washington University School of Medicine in St. Louis.

“To help hospitals realize these savings, some makers of CAD software provide services that convert anatomical data to CAD files. One example is BioCAD, from SolidWorks. The translation is done by Biomedical Modeling Inc., which makes anatomically accurate 3D reconstructions of the heart, blood vessels, bones, and internal organs,” says Crispin Weinberg, BMI president.

Training, device development
Other models aren’t taken directly from a patient’s CAT, X-ray or MRI; rather, 3D patient anatomy models—based on general-patient CAD data—can be used to more generally guide surgery and to train physicians and other healthcare workers. “Medical device developers also use the models when they create minimally invasive medical devices,” Weinberg says.

The practice of 3D-printed medical models is so widespread that in 2019, the American Medical Association approved four initial current procedural terminally (CTP) reimbursement codes for 3-D printed models. The codes are used to submit reimbursement requests for medical procedures.

“The American College of Radiology and the Radiological Society of North America had been working toward those codes for the changes for some time,” says Frank Rybicki, Vice Chair of quality and safety radiology at the University of Cincinnati College of Medicine

“Medical models and surgical guides have been 3D printed for well over a decade, as niche applications, without CPT codes,” Rybicki adds. “For example, craniomaxillofacial care providers generally accept that 3D printing is valuable and integral to patient care. However, when applying for CPT codes, it became clear that this ‘general acceptance’ lacked peer-reviewed literature to demonstrate value.”

Journal papers like Ballard’s and his colleagues are helping move 3D printing into the mainstream, Rybicki notes.

“The temporary codes are used to define 3D printing’s use in the medical field. Defining the role had been difficult because the technology had traditionally been used for a range of techniques and the uses weren’t well documented,” Rybicki says.

Rybicki founded a RSNA special interest group on 3D printing. In 2019, the society helped establish a registry to gather clinical data on medical 3D printing.

The 3D printing information within the hospital setting collected by the RSNA and ACR will help set formal CPT code nomenclature.

That’s entertainment
Some medical CAD models aren’t actually used for medical purposes. If you’ve seen the movie Hollow Man, for example, you’ve seen digital CAD models from Zygote Media Group, which builds and sells detailed 3D models of the human body based on MRI and CT data.

“Their models include the human skeleton, heart, arteries, nerves, and muscle tissue,” says David Dunston, Zygote executive partner.

“Some Zygote’s customers do use the CAD models to develop biomedicine products. A biomedical company may use 3D heart models to develop stents or a skeletal model to design a brace to straighten a crooked spine,” Dunston says.
“But the models are also used to drop realistic human-looking body parts into video games, commercials, and movies,” Dunston says.

The company’s CAD models have appeared in movies like Hollow Man, in television commercials, and on The Discovery Channel. They’ve also made appearances in a host of university classrooms and corporate training videos, he adds.

Creating body parts
In 2017, Chris Cahill, a New Jersey resident, woke up from a two-months-long coma caused by a brain injury. His brain swelling from the unknown trauma had been life threatening and the patient’s skull itself was infected, says Gaurav Gupta, assistant professor of neurosurgery at Rutgers Robert Wood Johnson Medical School.

“The infected frontal lobe of Cahill’s skull would need to be replaced,” Gupta says.

The surgical team had to custom-make the part to exactly fit Cahill’s skull, he adds. Using Cahill’s CT scans, Gupta’s team 3D printed a model of the skull and a custom-fit implant that would replace the missing piece.

Cahill was nervous about the surgery, but he woke up looking like his old self again.

Gupta pointed out the similarities between the way 3D CAD files and CT scans work. “For 3D printing, 3D CAD models are sliced into two-dimensional graphics files and each layer is then printed one atop the other until the final part is done. CT scans also break 3D images into 2D images each of which is one-slice thick,” Gupta says.

Cahill has been pleased with the results, according to news articles in which he’s quoted as saying he looks “as good as new.”

Printed prosthetics
The democratization of prosthetic design and creation through 3D printing enables millions of people around the world to reap the benefits of the newly popularized manufacturing technology.

The recent ubiquity of 3D printers and innovations in prosthetic design, manufacturing, and distribution offer a viable solution for the millions of people living with limb loss around the world. In the United States alone, close to 200,000 amputations are performed each year, yet, with prosthetics priced from $5,000-$50,000, having one can almost be considered a luxury, according to The Enable Community Foundation, a global network of volunteers who print prosthetic limbs for around $50.

Traditionally, the process of getting a prosthetic limb can take anywhere from weeks to months. Because prosthetics are such personal items, each one has to (or should) be custom-made or fit to the needs of the wearer. However, as 3D printers become more affordable, with some available for less than $200, the possibility of anyone being able to design and print a prosthetic limb in their home or local community could become a reality, according to Jon Schull, Enable board chair president.

In the near future, prosthetics will be seamlessly integrated into people’s everyday lives with minimal effort. New 3D scanning and body modeling technologies from companies such as Body Labs enable people to 3D scan their limbs and have prosthetics modeled after them, making for a more natural fit and appearance.

Technological developments from innovators such as Hugh Herr—a rock climber an MIT biophysicist—have introduced new abilities, including propulsion sensors and sophisticated algorithms that work together to automate more natural joint movement.

“The development of predictive movement for prosthetics will make it so people won’t have to think hard about controlling the device. Soon, prosthetics will move with more fluidity to mimic natural movement, and people will be able to control them in part with their brains and bodies through direct natural touch input systems,” Herr says.

New body parts for transplant
From prosthetics to actual body parts: researchers are at work on ways to actually print living tissue from CAD files.
In recent years, 3D bioprinting has made huge strides toward the goal of printing organs that can be successfully transplanted into humans. “While that’s still far in the future, the method continues to be studied and advances can lead to new and improved treatments for conditions such as spinal cord injury, Alzheimer’s disease, Parkinson’s disease, brain cancer, and more,” says Steinbacher of the Yale School of Medicine.

The 3D printing of living cells follows standard 3D printing methods with a few twists. The printer, following a CAD file, lays down layer upon layer of material to build a shape. Instead of metals or plastics, bioprinters use bioinks as their materials. These contain living cells amid viscous materials like alginate or gelatin. “The cells are often built upon scaffolding to support and protect the cells,” Steinbacher says.

As these examples show, the intersection of healthcare and 3D printing is only in its first stages. It’s not the stuff of science fiction. 3D printing, CAD, and medicine have come together to bring us a better quality of life. Even 20 years ago, these results were unthinkable.

Cahill, as he goes about his days, is thankful times have changed and 3D printing has made the inroads it has into medicine.

by Karl Maddix, co-founder and CEO of Masters of Pie

The coronavirus pandemic has forced almost every business to adapt to new ways of working. In many cases, conferencing services have saved the day – enabling remote teams to collaborate on projects when they can’t be in the same room. But two-dimensional (2D) conferencing is a poor substitute for engineers trying to work together remotely on complex 3D data to design the latest motor vehicle or jet engine.

And trying to untangle complex problems remotely from thousands of miles away is fraught with difficulties – even when using products like Microsoft’s Remote Assist. The expert often has to resort to waving their hands around on a screen to communicate to the technician which part of a machine they should be fixing – and which parts should be left alone.

Real-time immersive 3D collaboration is now adding a new dimension to such problem solving – users can share live, complex 3D files such as CAD data, interact with them and reveal ‘hidden’ parts deep within a machine that may be causing an issue. The technology also transforms day-to-day collaboration between remote engineering team members. Design reviews, for example, can be brought to life, with participants ‘walking through’ a model, no matter where they are in the world.

The fundamental problem at the root of many of these issues until now has been that enterprise teams have lacked the ability to effectively collaborate in real time using live, complex 3D data. The solution lies in purpose-built framework technology for integrating natively real-time collaboration and immersive device support directly into legacy enterprise software packages.

The key to enabling true real-time collaboration is to start where the data ‘sits’ and ensure that this original data ‘truth’ is the same for everybody when working together, no matter where they are located or what device they wish to use. This way, everyone in the team has the correct and most up-to-date information available.

Whether it is a CAD package, PLM software, an MRI scanner, robotic simulation software or a laser scanning system, many industries are becoming increasingly dependent on spatial data types and digital twins. These complex data formats are usually incompatible or just too cumbersome to use ‘as is’ in existing collaboration platforms such as Webex, Skype, Google docs or Slack – all built primarily for 2D data formats such as video, text or images.

Moreover, the legacy software generating the data itself is unlikely to have any in-built real-time collaboration functionality – forcing enterprise users to resort to one of two methods. One option is to manually export the data, carry out a painful and time-consuming reformatting process, then manually import the newly crunched data into some type of third-party standalone collaboration package. The alternative is to ignore the spatial nature of the data entirely and instead screen-grab or render out 2D ‘flat’ images of the original 3D data for use in a basic PowerPoint presentation or something similar.

Neither of these methods allows teams to efficiently collaborate using a live data truth – i.e. the original data itself instead of a reformatted, already out-of-date interpretation of it. So, both methods only compound the root collaboration problem instead of helping to solve it.

The latest generation of real-time immersive 3D collaboration technology is integrated directly into the host software, grabbing the original data at source before efficiently pushing it into a real-time environment which users can access using their choice of device (VR, AR, desktop, browser or mobile) for instant and intuitive collaboration. End-to-end encryption ensures that even the most sensitive data may be confidently shared across remote locations.

The integration into the host package provides not only a live connection to the data but also a bi-directional connection, meaning that users are still connected to the host software package running in the background. The advantage of this over standalone applications is that it still gives access to core features of the host package – enabling accurate measurement of a CAD model using vertex or spline snapping to the original B-Rep held in the CAD package, for example. All the underlying metadata from the host package is also available to the immersive experience – and annotations, snapshots, action lists or spatial co-ordinate changes can be saved back into the host package.

The new post-pandemic requirement to have a distributed workforce – in conjunction with the rollout and adoption of key technology enablers such as server-side rendering and high-capacity, low-latency connectivity – is set to accelerate the adoption and integration of real-time immersive collaboration solutions. In the future, 5G technology will also open up the potential to stream to immersive AR and VR devices – untethering the experience and facilitating factory-wide adoption of immersive solutions. For example, as ‘Industrial Internet of Things’ (IIoT) data streams from smart devices in the factory, it will be overlaid via AR glasses in the physical space. And as cloud service providers build out features such as spatial anchoring to support ever-larger physical spaces, these new services will be used within collaborative environments rich with real-time data.

Factory workers, for example, will have the ability to ‘dial an expert’ directly from a virtual panel on a smart factory device. This offsite expert will appear as a holographic colleague and bring with them live 3D data for that individual machine. Both users will have real-time IIoT data overlaid intuitively on the fully interactive 3D model to facilitate a more effective diagnosis and maintenance process.

Empowering shop-floor workers with hands-free AR and detailed 3D data will dramatically improve assembly line efficiency, with an intuitive environment where product data is fully interactive. Users will be able to move, hide, isolate and cross-section through parts, while using mark-up and voice tools to create efficient instructions for the assembly or disassembly of complex products. These instructions will be recorded and delivered as holographic guides via AR directly on the assembly line.

The next generation of real-time immersive 3D collaboration technology is even set to enable you to have a scaled-down hologram of your latest engine design sitting right in front of you on your desk. As you work on the design and refine it using your CAD software, the changes will be dynamically loaded into the hologram so that you can see the effects immediately and make any further necessary adjustments.

Meanwhile, digital sleeving – with 3D images overlaid on physical designs – will enable you to check how two parts of the engine come together, even when they are being designed by different teams in different locations. Similarly, you will be able to see how, for example, cabling will fit inside your latest aircraft seat design or where best to put the maintenance pockets for easy access.

This kind of approach adds a new dimension to the handoff between design and manufacturing. If adjustments need to be made to a fan assembly design, for example, the relevant part can be isolated within an immersive design review – and speech-to-text notes can be added to the part number and automatically become part of the change request. It’s all a far cry from endless design iterations, spreadsheets and printouts – or CAD screen shares using a 2D representation of a 3D problem.

In the post-pandemic remote world, conferencing is bringing people, video and documents together. Collaboration is now adding the fourth dimension of 3D immersive experience to complete the picture.