Intelligent Image-Activated Cell Sorting

Cell

Volumn 175, Issue 1, 2018, Pages 266-276.e13

  Nitta, Nao ^a,b   Sugimura, Takeaki ^a,b   Isozaki, Akihiro ^a   Mikami, Hideharu ^a   Hiraki, Kei ^a   Sakuma, Shinya ^c   Iino, Takanori ^a   Arai, Fumihito ^c   Endo, Taichiro ^d,e   Fujiwaki, Yasuhiro ^a   Fukuzawa, Hideya ^f   Hase, Misa ^a   Hayakawa, Takeshi ^g   Hiramatsu, Kotaro ^a   Hoshino, Yu ^h   Inaba, Mary ^a   Ito, Takuro ^a,b   Karakawa, Hiroshi ^a   Kasai, Yusuke ^c   Koizumi, Kenichi ^a   Lee, SangWook ^a   Lei, Cheng ^a   Li, Ming ⁱ   Maeno, Takanori ^a   Matsusaka, Satoshi ^j   Murakami, Daichi ^a   Nakagawa, Atsuhiro ^k   Oguchi, Yusuke ^a   Oikawa, Minoru ^l   Ota, Tadataka ^a   Shiba, Kiyotaka ^m   Shintaku, Hirofumi ^f   Shirasaki, Yoshitaka ^a   Suga, Kanako ^m   Suzuki, Yuta ^a   Suzuki, Nobutake ^a   Tanaka, Yo ⁿ   Tezuka, Hiroshi ^a   Toyokawa, Chihana ^f   Yalikun, Yaxiaer ⁿ   Yamada, Makoto ^d,f   Yamagishi, Mai ^a   Yamano, Takashi ^f   Yasumoto, Atsushi ^o   Yatomi, Yutaka ^o   Yazawa, Masayuki ^p   Di Carlo, Dino ^a,i,q   Hosokawa, Yoichiroh ^r   Uemura, Sotaro ^a   Ozeki, Yasuyuki ^a   Goda, Keisuke ^a,b,q   more..

^a UNIVERSITY OF TOKYO   (Japan)

^b JAPAN SCIENCE AND TECHNOLOGY AGENCY   (Japan)

^c NAGOYA UNIVERSITY   (Japan)

^d Disaster Resilience Science Team   (Japan)

^e ExaWizards Inc   (Japan)

^f KYOTO UNIVERSITY   (Japan)

^g CHUO UNIVERSITY   (Japan)

^h KYUSHU UNIVERSITY   (Japan)

ⁱ Engineering IV   (United States)

^j CANCER INSTITUTE HOSPITAL   (Japan)

^k TOHOKU UNIVERSITY GRADUATE SCHOOL OF MEDICINE   (Japan)

^l KOCHI UNIVERSITY   (Japan)

^m CANCER INSTITUTE   (Japan)

ⁿ RIKEN Center for Biosystems Dynamics Research   (Japan)

^o UNIVERSITY OF TOKYO   (Japan)

^p Och Spine at New York Presbyterian Hospitals   (United States)

^q UNIVERSITY OF CALIFORNIA   (United States)

^r NARA INSTITUTE OF SCIENCE AND TECHNOLOGY   (Japan)

more..

Author keywords

cellular heterogeneity; cellular morphology; convolutional neural network; deep learning; high throughput microscopy; high throughput screening; image activated cell sorting; machine intelligence

Indexed keywords

ARTICLE; AUTOMATION; BLOOD CELL; CELL INTERACTION; CELL SELECTION; CELL STRUCTURE; CHLAMYDOMONAS REINHARDTII; DECISION MAKING; FEMALE; FLUORESCENCE ACTIVATED CELL SORTING; HUMAN; HUMAN CELL; IMAGE PROCESSING; INTELLIGENT IMAGE ACTIVATED CELL SORTING; MALE; MICROALGA; MICROSCOPY; MOLECULAR CLONING; MOLECULAR IMAGING; NONHUMAN; NORMAL HUMAN; PHOTOSYNTHESIS; PRIORITY JOURNAL; PROTEIN LOCALIZATION; THROMBOCYTE AGGREGATION; ANIMAL; FLOW CYTOMETRY; HIGH THROUGHPUT SCREENING; PROCEDURES;

ANIMALS; DEEP LEARNING; FLOW CYTOMETRY; HIGH-THROUGHPUT SCREENING ASSAYS; HUMANS; IMAGE PROCESSING, COMPUTER-ASSISTED;

EID: 85054484004     PISSN: 00928674     EISSN: 10974172     Source Type: Journal    
DOI: 10.1016/j.cell.2018.08.028     Document Type: Article

References (58)

1. Abadi, M., Agarwal, A., Barham, P., Brevdo, E., Chen, Z., Citro, C., Corrado, G.S., Davis, A., Dean, J., Devin, M., et al. (2016). TensorFlow: large-scale machine learning on heterogeneous distributed systems. arXiv:1603.04467v2.
2. Altschuler, S.J., Wu, L.F., Cellular heterogeneity: do differences make a difference?. Cell 141 (2010), 559–563.
3. Basiji, D.A., Ortyn, W.E., Liang, L., Venkatachalam, V., Morrissey, P., Cellular image analysis and imaging by flow cytometry. Clin. Lab. Med., 27, 2007, 653 670, viii.
4. Boutros, M., Heigwer, F., Laufer, C., Microscopy-based high-content screening. Cell 163 (2015), 1314–1325.
5. Bradski, G. (2000). The OpenCV Library. Dr. Dobb's Journal of Software Tools. Art. ID: 2236121. Available at https://opencv.org.
6. Brasko, C., Smith, K., Molnar, C., Farago, N., Hegedus, L., Balind, A., Balassa, T., Szkalisity, A., Sukosd, F., Kocsis, K., et al. Intelligent image-based in situ single-cell isolation. Nat. Commun., 9, 2018, 226.
7. Burg, T.P., Godin, M., Knudsen, S.M., Shen, W., Carlson, G., Foster, J.S., Babcock, K., Manalis, S.R., Weighing of biomolecules, single cells and single nanoparticles in fluid. Nature 446 (2007), 1066–1069.
8. Caicedo, J.C., Cooper, S., Heigwer, F., Warchal, S., Qiu, P., Molnar, C., Vasilevich, A.S., Barry, J.D., Bansal, H.S., Kraus, O., et al. Data-analysis strategies for image-based cell profiling. Nat. Methods 14 (2017), 849–863.
9. Chattopadhyay, P.K., Gierahn, T.M., Roederer, M., Love, J.C., Single-cell technologies for monitoring immune systems. Nat. Immunol. 15 (2014), 128–135.
10. Chen, C.L., Mahjoubfar, A., Tai, L.-C., Blaby, I.K., Huang, A., Niazi, K.R., Jalali, B., Deep learning in label-free cell classification. Sci. Rep., 6, 2016, 21471.
11. Chen, Y., Wu, T.-H., Kung, Y.-C., Teitell, M.A., Chiou, P.-Y., 3D pulsed laser-triggered high-speed microfluidic fluorescence-activated cell sorter. Analyst (Lond.) 138 (2013), 7308–7315.
12. Chollet, F. (2015). Keras: Deep learning for humans. Software available from GitHub repository. Available at https://github.com/keras-team/keras.
13. Davì G., Patrono, C., Platelet activation and atherothrombosis. N. Engl. J. Med. 357 (2007), 2482–2494.
14. Engelmann, B., Massberg, S., Thrombosis as an intravascular effector of innate immunity. Nat. Rev. Immunol. 13 (2013), 34–45.
15. Eulenberg, P., Köhler, N., Blasi, T., Filby, A., Carpenter, A.E., Rees, P., Theis, F.J., Wolf, F.A., Reconstructing cell cycle and disease progression using deep learning. Nat. Commun., 8, 2017, 463.
16. Fabbri, F., Carloni, S., Zoli, W., Ulivi, P., Gallerani, G., Fici, P., Chiadini, E., Passardi, A., Frassineti, G.L., Ragazzini, A., Amadori, D., Detection and recovery of circulating colon cancer cells using a dielectrophoresis-based device: KRAS mutation status in pure CTCs. Cancer Lett. 335 (2013), 225–231.
17. 2-concentrating organelle is liquid-like and exhibits dynamic reorganization. Cell 171 (2017), 148–162.e19.
18. George, T.C., Basiji, D.A., Hall, B.E., Lynch, D.H., Ortyn, W.E., Perry, D.J., Seo, M.J., Zimmerman, C.A., Morrissey, P.J., Distinguishing modes of cell death using the ImageStream multispectral imaging flow cytometer. Cytometry A 59 (2004), 237–245.
19. George, T.C., Fanning, S.L., Fitzgerald-Bocarsly, P., Medeiros, R.B., Highfill, S., Shimizu, Y., Hall, B.E., Frost, K., Basiji, D., Ortyn, W.E., et al. Quantitative measurement of nuclear translocation events using similarity analysis of multispectral cellular images obtained in flow. J. Immunol. Methods 311 (2006), 117–129.
20. Girault, M., Kim, H., Arakawa, H., Matsuura, K., Odaka, M., Hattori, A., Terazono, H., Yasuda, K., An on-chip imaging droplet-sorting system: a real-time shape recognition method to screen target cells in droplets with single cell resolution. Sci. Rep., 7, 2017, 40072.
21. Godin, M., Delgado, F.F., Son, S., Grover, W.H., Bryan, A.K., Tzur, A., Jorgensen, P., Payer, K., Grossman, A.D., Kirschner, M.W., Manalis, S.R., Using buoyant mass to measure the growth of single cells. Nat. Methods 7 (2010), 387–390.
22. Grys, B.T., Lo, D.S., Sahin, N., Kraus, O.Z., Morris, Q., Boone, C., Andrews, B.J., Machine learning and computer vision approaches for phenotypic profiling. J. Cell Biol. 216 (2017), 65–71.
23. Hao, N., Budnik, B.A., Gunawardena, J., O'Shea, E.K., Tunable signal processing through modular control of transcription factor translocation. Science 339 (2013), 460–464.
24. Henery, S., George, T., Hall, B., Basiji, D., Ortyn, W., Morrissey, P., Quantitative image based apoptotic index measurement using multispectral imaging flow cytometry: a comparison with standard photometric methods. Apoptosis 13 (2008), 1054–1063.
25. Hennig, H., Rees, P., Blasi, T., Kamentsky, L., Hung, J., Dao, D., Carpenter, A.E., Filby, A., An open-source solution for advanced imaging flow cytometry data analysis using machine learning. Methods 112 (2017), 201–210.
26. Hiraki, K., Inaba, M., Tezuka, H., Tomari, H., Koizumi, K., Kondo, S., All-IP-Ethernet architecture for real-time sensor-fusion processing. Proceedings of SPIE BiOS, 9720, 2016, 97200D.
27. Hung, P.J., Lee, P.J., Sabounchi, P., Aghdam, N., Lin, R., Lee, L.P., A novel high aspect ratio microfluidic design to provide a stable and uniform microenvironment for cell growth in a high throughput mammalian cell culture array. Lab Chip 5 (2005), 44–48.
28. Jiang, Y., Lei, C., Yasumoto, A., Kobayashi, H., Aisaka, Y., Ito, T., Guo, B., Nitta, N., Kutsuna, N., Ozeki, Y., et al. Label-free detection of aggregated platelets in blood by machine-learning-aided optofluidic time-stretch microscopy. Lab Chip 17 (2017), 2426–2434.
29. Kasai, F., Kawachi, M., Erata, M., Watanabe, M.M., NIES-collection. List of Strains. Microalgae and Protozoa. Seventh Edition, 2004, National Institute for Environmental Studies, Tsukuba, Japan, 257.
30. Kobayashi, H., Lei, C., Wu, Y., Mao, A., Jiang, Y., Guo, B., Ozeki, Y., Goda, K., Label-free detection of cellular drug responses by high-throughput bright-field imaging and machine learning. Sci. Rep., 7, 2017, 12454.
31. Lauersen, K.J., Kruse, O., Mussgnug, J.H., Targeted expression of nuclear transgenes in Chlamydomonas reinhardtii with a versatile, modular vector toolkit. Appl. Microbiol. Biotechnol. 99 (2015), 3491–3503.
32. LeCun, Y., Bengio, Y., Hinton, G., Deep learning. Nature 521 (2015), 436–444.
33. LeCun, Y., Boser, B., Denker, J.S., Henderson, D., Howard, R.E., Hubbard, W., Jackel, L.D., Backpropagation applied to handwritten zip code recognition. Neural Comput. 1 (1989), 541–551.
34. Lee, D., Mehta, N., Shearer, A., Kastner, R., A hardware accelerated system for high throughput cellular image analysis. J. Parallel Distrib. Comput. 113 (2018), 167–178.
35. Libby, P., Current concepts of the pathogenesis of the acute coronary syndromes. Circulation 104 (2001), 365–372.
36. Lodha, M., Schulz-Raffelt, M., Schroda, M., A new assay for promoter analysis in Chlamydomonas reveals roles for heat shock elements and the TATA box in HSP70A promoter-mediated activation of transgene expression. Eukaryot. Cell 7 (2008), 172–176.
37. 2-concentrating mechanism. Cell 171 (2017), 133–147.e14.
38. Meng, P., Jacobsen, M., Kimura, M., Dergachev, V., Anantharaman, T., Requa, M., Kastner, R., Hardware accelerated alignment algorithm for optical labeled genomes. ACM Trans. Reconfig. Technol. Syst., 9, 2016 10.1145/2840811.
39. Mikami, H., Harmon, J., Kobayashi, H., Hamad, S., Wang, Y., Iwata, O., Suzuki, K., Ito, T., Aisaka, Y., Kutsuna, N., et al. Ultrafast confocal fluorescence microscopy beyond the fluorescence lifetime limit. Optica 5 (2018), 117–126.
40. Moor, A.E., Golan, M., Massasa, E.E., Lemze, D., Weizman, T., Shenhav, R., Baydatch, S., Mizrahi, O., Winkler, R., Golani, O., et al. Global mRNA polarization regulates translation efficiency in the intestinal epithelium. Science 357 (2017), 1299–1303.
41. Nakazawa, Y., Hiraki, M., Kamiya, R., Hirono, M., SAS-6 is a cartwheel protein that establishes the 9-fold symmetry of the centriole. Curr. Biol. 17 (2007), 2169–2174.
42. Nielsen, J., Keasling, J.D., Engineering cellular metabolism. Cell 164 (2016), 1185–1197.
43. Ota, S., Horisaki, R., Kawamura, Y., Ugawa, M., Sato, I., Hashimoto, K., Kamesawa, R., Setoyama, K., Yamaguchi, S., Fujiu, K., et al. Ghost cytometry. Science 360 (2018), 1246–1251.
44. Pernas, L., Bean, C., Boothroyd, J.C., Scorrano, L., Mitochondria restrict growth of the intracellular parasite Toxoplasma gondii by limiting its uptake of fatty acids. Cell Metab. 27 (2018), 886–897.e4.
45. Piatkevich, K.D., Jung, E.E., Straub, C., Linghu, C., Park, D., Suk, H.-J., Hochbaum, D.R., Goodwin, D., Pnevmatikakis, E., Pak, N., et al. A robotic multidimensional directed evolution approach applied to fluorescent voltage reporters. Nat. Chem. Biol. 14 (2018), 352–360.
46. R Core Team. R: A language and environment for statistical computing. 2016, R Foundation for Statistical Computing, Vienna, Austria Available at https://www.R-project.org.
47. Sakuma, S., Kasai, Y., Hayakawa, T., Arai, F., On-chip cell sorting by high-speed local-flow control using dual membrane pumps. Lab Chip 17 (2017), 2760–2767.
48. Schindelin, J., Arganda-Carreras, I., Frise, E., Kaynig, V., Longair, M., Pietzsch, T., Preibisch, S., Rueden, C., Saalfeld, S., Schmid, B., et al. Fiji: an open-source platform for biological-image analysis. Nat. Methods 9 (2012), 676–682.
49. Stubbington, M.J.T., Rozenblatt-Rosen, O., Regev, A., Teichmann, S.A., Single-cell transcriptomics to explore the immune system in health and disease. Science 358 (2017), 58–63.
50. Sun, T., Kovac, J., Voldman, J., Image-based single-cell sorting via dual-photopolymerized microwell arrays. Anal. Chem. 86 (2014), 977–981.
51. Tung, J.W., Heydari, K., Tirouvanziam, R., Sahaf, B., Parks, D.R., Herzenberg, L.A., Herzenberg, L.A., Modern flow cytometry: a practical approach. Clin. Lab. Med., 27, 2007, 453 468, v.
52. von Erlach, T.C., Bertazzo, S., Wozniak, M.A., Horejs, C.-M., Maynard, S.A., Attwood, S., Robinson, B.K., Autefage, H., Kallepitis, C., Del Río Hernández, A., et al. Cell-geometry-dependent changes in plasma membrane order direct stem cell signalling and fate. Nat. Mater. 17 (2018), 237–242.
53. Wakisaka, Y., Suzuki, Y., Iwata, O., Nakashima, A., Ito, T., Hirose, M., Domon, R., Sugawara, M., Tsumura, N., Watarai, H., et al. Probing the metabolic heterogeneity of live Euglena gracilis with stimulated Raman scattering microscopy. Nat. Microbiol., 1, 2016, 16124.
54. 2+-binding protein CAS in the green alga Chlamydomonas reinhardtii. Proc. Natl. Acad. Sci. USA 113 (2016), 12586–12591.
55. Wu, C.-Y., Stoecklein, D., Kommajosula, A., Lin, J., Owsley, K., Ganapathysubramanian, B., Di Carlo, D., Shaped 3D microcarriers for adherent cell culture and analysis. Microsys. Nanoeng., 4, 2018, 21.
56. Yamano, T., Asada, A., Sato, E., Fukuzawa, H., Isolation and characterization of mutants defective in the localization of LCIB, an essential factor for the carbon-concentrating mechanism in Chlamydomonas reinhardtii. Photosynth. Res. 121 (2014), 193–200.
57. Yamano, T., Iguchi, H., Fukuzawa, H., Rapid transformation of Chlamydomonas reinhardtii without cell-wall removal. J. Biosci. Bioeng. 115 (2013), 691–694.
58. Zenker, J., White, M.D., Templin, R.M., Parton, R.G., Thorn-Seshold, O., Bissiere, S., Plachta, N., A microtubule-organizing center directing intracellular transport in the early mouse embryo. Science 357 (2017), 925–928.