Preprints and Recent papers

G. Arpino, X. Liu, and R. Venkataramanan, "Inferring Change Points in High-Dimensional Linear Regression via Approximate Message Passing", ICML 2024. [PDF]

X. Liu, K. Hsieh, and R. Venkataramanan, "Coded many-user multiple access via Approximate Message Passing", ISIT 2024. [PDF]

B. Ananthasubramaniam and R. Venkataramanan, "Time series-free rhythm profiling using COFE reveals multi-omic circadian rhythms in in-vivo human cancers". [PDF]

P. Pascual Cobo, K. Hsieh, R. Venkataramanan, "Bayes-Optimal Estimation in Generalized Linear Models via Spatial Coupling". [PDF]

Y. Zhang, H. C. Ji, R.Venkataramanan, M. Mondelli, "Spectral Estimators for Structured Generalized Linear Models via Approximate Message Passing", COLT 2024. [PDF]

Y. Zhang, M. Mondelli, R. Venkataramanan, "Precise Asymptotics for Spectral Methods in Mixed Generalized Linear Models". [PDF]

Monographs

O. Feng, R. Venkataramanan, C. Rush, R. Samworth, "A unifying tutorial on Approximate Message Passing", Foundations and Trends in Machine Learning, vol. 15, no. 4, pp. 335-536, 2022. [PDF]

R. Venkataramanan, S. Tatikonda and A. Barron, "Sparse Regression Codes", Foundations and Trends in Communications and Information Theory, vol. 15, no. 1-2, pp. 1-195, 2019. [PDF]

Journal Articles

N. Tan, P. Pascual Cobo, J. Scarlett, R. Venkataramanan, "Approximate Message Passing with Rigorous Guarantees for Pooled Data and Quantitative Group Testing", to appear in SIAM Journal on Mathematics of Data Science, 2024. [PDF]

N. Tan, R.Venkataramanan, "Mixed Regression via Approximate Message Passing", Journal of Machine Learning Research, vol. 24, no. 317, pp. 1-44, 2023. [PDF]

X. Liu, R. Venkataramanan, "Sketching sparse low-rank matrices with near-optimal sample- and time-complexity", IEEE Transactions on Information Theory, vol. 69, no. 9, pp. 6071-6097, September 2023. [PDF]

K. Hsieh, C. Rush, and R. Venkataramanan, "Near-optimal coding for many-user multiple access channels", IEEE Journal on Selected Areas in Information Theory, vol. 3, no. 1, pp. 21-36, March 2022. [PDF]

M. Mondelli, C. Thrampoulidis, R. Venkataramanan, "Optimal combination of linear and spectral estimators for generalized linear models", Foundations of Computational Mathematics, vol. 22, pp. 1513-1566, October 2022. [PDF]

M. Mondelli and R. Venkataramanan, "Approximate Message Passing with Spectral Initialization for Generalized Linear Models", Journal of Statistical Mechanics: Theory and Experiment , November 2022. [PDF]

C. Rush, K. Hsieh, and R. Venkataramanan, "Capacity-achieving spatially coupled sparse superposition codes with AMP decoding", IEEE Transactions on Information Theory, vol. 67, no. 7, pp. 4446 - 4484, July 2021. [PDF]

K. Hsieh, and R. Venkataramanan, "Modulated sparse superposition codes for the complex AWGN channel", IEEE Transactions on Information Theory, vol. 67, no. 7, pp. 4385 - 4404, July 2021. [PDF]

A. Montanari and R. Venkataramanan, "Estimation of low-rank matrices via Approximate Message Passing", Annals of Statistics, vol. 49, no. 1, pp. 321-345, February 2021. [PDF]

M. Abroshan, R. Venkataramanan, and A. Guillen i Fabregas "Multilayer codes for synchronization from deletions and insertions", IEEE Transactions on Information Theory, vol. 67, no. 6, pp. 3342-3359, June 2021. [PDF]

F. Knight, C. Connor, R. Venkataramanan, and R. Asher, "Body temperatures, life history, and skeletal morphology in the nine-banded armadillo (Dasypus novemcinctus)", Peer Community in Ecology, 2020. [Editorial summary and PDF] [Summary video by R. Asher]

K. P. Srinath and R. Venkataramanan, "Empirical Bayes estimators for high-dimensional sparse vectors", Information and Inference: A Journal of the IMA, vol. 9, no. 1, pp. 195-234, March 2020. [PDF] [Code]

C. Rush and R. Venkataramanan, "The error probability of sparse superposition codes with Approximate Message Passing decoding", IEEE Transactions on Information Theory, vol. 65, no.5, pp. 3278-3303, May 2019. [PDF]

C. Rush and R. Venkataramanan, "Finite sample analysis of Approximate Message Passing algorithms", IEEE Transactions on Information Theory, vol. 64, no. 11, pp. 7264-7286, November 2018. [PDF]

R. Venkataramanan and O. Johnson, "A strong converse bound for multiple hypothesis testing, with applications to high-dimensional estimation", Electronic Journal of Statistics, Vol. 12, No. 1, pp. 1126-1149, 2018. [PDF]

M. Abroshan, R. Venkataramanan, and A. Guillen i Fabregas, "Coding for segmented edit channels", IEEE Transactions on Information Theory, vol. 64, no. 4, pp. 3086-3098, April 2018. [PDF]

A. Greig and R. Venkataramanan, "Techniques for improving the finite length performance of sparse superposition codes", IEEE Transactions on Communications, vol. 66, no. 3, pp.905-917, March 2018. [PDF]

K. P. Srinath and R. Venkataramanan, "Cluster-seeking James-Stein estimators", IEEE Transactions on Information Theory, vol. 64, no. 2, pp. 853-874, February 2018. [PDF]

R. Venkataramanan and S. Tatikonda, "The Rate-Distortion Function and Excess-Distortion Exponent of Sparse Regression Codes with Optimal Encoding", IEEE Transactions on Information Theory, vol. 63, no. 8, pp. 5228-5243, August 2017. [PDF]

C. Rush, A. Greig, and R. Venkataramanan, "Capacity-achieving Sparse Superposition Codes with Approximate Message Passing Decoding", IEEE Transactions on Information Theory, vol. 63, no. 3, pp. 1476-1500, March 2017. [PDF]

R. Venkataramanan, V. N. Swamy and K. Ramchandran, "Low-Complexity Interactive Algorithms for Synchronization from Deletions, Insertions, and Substitutions", IEEE Transactions on Information Theory, vol. 61, no. 10, pp. 5670-5689, October 2015. [PDF]

R. Venkataramanan, T. Sarkar and S. Tatikonda, "Lossy Compression via Sparse Linear Regression: Computationally Efficient Encoding and Decoding", IEEE Transactions on Information Theory, vol. 60, no. 6, pp. 3265-3278, June 2014. [PDF]

R. Venkataramanan, A. Joseph and S. Tatikonda, "Lossy Compression via Sparse Linear Regression: Performance under Minimum-distance Encoding", IEEE Transactions on Information Theory, vol. 60, no. 6, pp. 3254-3264, June 2014. [PDF]

R. Venkataramanan, S. Tatikonda, L. Lastras-Montaño and M. Franceschini, "Rewritable storage channels with hidden state", IEEE Journal on Selected Areas in Communications, vol. 32, no. 5, pp. 815-824, May 2014. [PDF]

R. Venkataramanan, S. Tatikonda and K. Ramchandran, "Achievable rates for channels with deletions and insertions", IEEE Transactions on Information Theory, vol. 59, no.11, pp. 6990-7013, November 2013. [PDF]

R. Venkataramanan and S. S. Pradhan, "An achievable rate region for the broadcast channel with feedback", IEEE Transactions on Information Theory, vol. 59, no.10, pp. 6175-6191, October 2013. [PDF]

R. Venkataramanan and S. S. Pradhan, "A New Achievable Rate Region for the Discrete memoryless multiple-access channel with feedback", IEEE Transactions on Information Theory, vol. 57, no.12, pp. 8038-8054, December 2011. [PDF]

R. Venkataramanan and S. S. Pradhan, "Achievable rates for multiple descriptions with feed-forward", IEEE Transactions on Information Theory, vol. 57, no.4, pp. 2270-2277, April 2011. [PDF]

R. Venkataramanan and S. S. Pradhan, "On computing the feedback capacity of channels and the feed-forward rate-distortion function of sources", IEEE Transactions on Communications, vol. 58, pp. 1889-1896, July 2010. [PDF]

R. Venkataramanan and S. S. Pradhan, "Source coding with feedforward: Rate-distortion theorems and error exponents for a general source", IEEE Transactions on Information Theory, vol. 53, pp. 2154-2179, June 2007. [PDF]

R. Venkataramanan and K. M. M. Prabhu, "Estimation of Frequency Offset using Warped DFT", Signal Processing, vol. 86, pp. 250-256, Feb. 2006 . [PDF]



Conference Proceedings

Y. Zhang, H. C. Ji, R.Venkataramanan, M. Mondelli, "Spectral Estimators for Structured Generalized Linear Models via Approximate Message Passing", COLT 2024. [PDF]

G. Arpino, X. Liu, and R. Venkataramanan, "Inferring Change Points in High-Dimensional Linear Regression via Approximate Message Passing", ICML 2024. [PDF]

X. Liu, K. Hsieh, and R. Venkataramanan, "Coded many-user multiple access via Approximate Message Passing", ISIT 2024. [PDF]

G. Arpino, R.Venkataramanan, "Statistical-Computational Tradeoffs in Mixed Sparse Linear Regression", COLT 2023. [PDF]

P. Pascual Cobo, K. Hsieh, R.Venkataramanan, "Bayes-Optimal Estimation in Generalized Linear Models via Spatial Coupling", ISIT 2023. [PDF]

N. Tan, R.Venkataramanan, "Mixed Linear Regression via Approximate Message Passing", AISTATS 2023. [PDF] [Poster]

R. Venkataramanan, K. Kögler, and M. Mondelli, "Estimation in Rotationally Invariant Generalized Linear Models via Approximate Message Passing", ICML 2022. [PDF] [Slides]

X. Liu, R. Venkataramanan, "Sketching sparse low-rank matrices with near-optimal sample- and time-complexity", ISIT 2022. [PDF]

M. Mondelli and R. Venkataramanan, "PCA Initialization for Approximate Message Passing in Rotationally Invariant Models", NeurIPS 2021. [PDF]

M. Mondelli and R. Venkataramanan, "Approximate Message Passing with Spectral Initialization for Generalized Linear Models", AISTATS 2021. [PDF]

K. Hsieh, C. Rush, and R. Venkataramanan, "Near-optimal coding for massive multiple access", Proc. IEEE Inf. Symp. on Information Theory (ISIT), 2021. [PDF]

K. Hsieh, and R. Venkataramanan, "Modulated Sparse Regression Codes", Proc. IEEE Inf. Symp. on Information Theory (ISIT), 2020. [PDF]

C. Rush, K. Hsieh, and R. Venkataramanan, "Spatially Coupled Sparse Regression Codes with Sliding Window AMP Decoding", Proc. IEEE Inf. Theory Workshop (ITW), 2019.

M. Heidari, S. Sandeep Pradhan and R. Venkataramanan, "Boolean Functions with Biased Inputs: Approximation and Noise Sensitivity", Proc. IEEE Int. Symp. on Information Theory (ISIT), 2019. [PDF]

M. Abroshan, R. Venkataramanan, L. Dolecek and A. Guillen i Fabregas, "Coding for Deletion Channels with Multiple Traces", Proc. IEEE Int. Symp. on Information Theory (ISIT), 2019. [PDF]

C. Rush, K. Hsieh, and R. Venkataramanan, "Capacity achieving sparse regression codes via spatial coupling", Proc. IEEE Inf. Theory Workshop (ITW), 2018.

K. Hsieh, C. Rush and R. Venkataramanan, "Spatially coupled sparse regression codes: design and state evolution analysis", Proc. IEEE Int. Symp. on Information Theory (ISIT), 2018.

K. P. Srinath and R. Venkataramanan, "Empirical Bayes estimators for sparse sequences", Proc. IEEE Int. Symp. on Information Theory (ISIT), 2018.

M. Abroshan, R. Venkataramanan, and A. Guillen i Fabregas, "Efficient systematic encoding of non-binary VT codes", Proc. IEEE Int. Symp. on Information Theory (ISIT), 2018.

M. Abroshan, R. Venkataramanan, and A. Guillen i Fabregas "Multilayer codes for synchronization from deletions", Proc. IEEE Information Theory Workshop (ITW), 2017.

M. Abroshan, R. Venkataramanan, and A. Guillen i Fabregas "Codes for Channels with Segmented Edits", Proc. IEEE Int. Symp. on Information Theory (ISIT), 2017.

C. Rush and R. Venkataramanan, "The Error Exponent of Sparse Regression Codes with AMP Decoding", Proc. IEEE Int. Symp. on Information Theory (ISIT), 2017.

C. Rush and R. Venkataramanan, "Finite Sample Analysis of Approximate Message Passing", Proc. IEEE Int. Symp. on Information Theory (ISIT), 2016.

K. P. Srinath and R. Venkataramanan, "Cluster-seeking Shrinkage Estimators", Proc. IEEE Int. Symp. on Information Theory (ISIT), 2016.

C. Rush, A. Greig, and R. Venkataramanan, "Capacity-achieving Sparse Regression Codes with Approximate Message Passing Decoding", Proc. IEEE Int. Symp. on Information Theory (ISIT), 2015.

R. Venkataramanan and S. Tatikonda, "The Gaussian Rate-Distortion Function of Sparse Regression Codes with Optimal Encoding", Proc. IEEE Int. Symp. on Information Theory (ISIT), 2014.

R. Venkataramanan, V. N. Swamy and K. Ramchandran, "Efficient Interactive Algorithms for File Synchronization under General Edits", Proc. 51st Allerton Conf. on Communication, Control, and Computing , 2013.

R. Venkataramanan and S. Tatikonda, "Sparse Regression Codes: Recent Results and Future Directions" (invited), Proc. IEEE Information Theory Workshop, 2013 .

R. Venkataramanan and S. Tatikonda, "Improved Capacity Lower Bounds for Channels with Deletions and Insertions", Proc. IEEE Information Theory Workshop, 2013.

R. Venkataramanan, T. Sarkar, and S. Tatikonda, "Lossy Compression via Sparse Linear Regression: Computationally Efficient Encoding and Decoding'', Proc. IEEE Int. Symp. on Information Theory (ISIT), 2013.

R. Venkataramanan and S. Tatikonda, "Sparse Regression Codes for Multi-terminal Source and Channel Coding", Proc. 50th Allerton Conf. on Communication, Control, and Computing , 2012.

R. Venkataramanan, S. Tatikonda, L. Lastras-Montaño and M. Franceschini, "Coding Strategies for the uniform noise rewritable channel with hidden state", Proc. IEEE Int. Symp. on Information Theory (ISIT), 2012.

R. Venkataramanan, A. Joseph, and S. Tatikonda, "Gaussian rate-distortion via sparse regression over compact dictionaries", Proc. IEEE Int. Symp. on Information Theory (ISIT), 2012.

R. Venkataramanan, S. Tatikonda and K. Ramchandran, "Achievable rates for channels with deletions and insertions", Proc. IEEE Int. Symp. on Information Theory (ISIT), 2011.

R. Venkataramanan, S. Tatikonda and K. Ramchandran, "Bounds on the optimal rate for synchronization from insertions and deletions", Proc. of the Information Theory and Applications Workshop , San Diego, Feb. 2011.

R. Venkataramanan, H. Zhang and K. Ramchandran, "Interactive Low-Complexity Codes for Synchronization from Deletions and Insertions", Proc. of the 48th Annual Allerton Conference(Monticello, IL), Sep. 2010.

R. Venkataramanan and S. S. Pradhan, "Achievable Rates for the Broadcast Channel with Feedback", Proc. IEEE Int. Symp. on Information Theory (ISIT), 2010.

A. Nazari, R. Venkataramanan , D. Krithivasan, S. S. Pradhan and A. Anastasopoulos, "Typicality graphs and their properties", Proc. IEEE Int. Symp. on Information Theory (ISIT), 2010.

R. Venkataramanan and S. S. Pradhan, "A New Achievable Rate Region for the Discrete Memoryless Multiple-Access Channel with Feedback", Proc. IEEE Int. Symp. on Information Theory (ISIT), 2009.

R. Venkataramanan and S. S. Pradhan, "Multiple Descriptions with Feed-forward: A Single-letter Achievable Rate Region ", Proc. IEEE Int. Symp. on Information Theory (ISIT), 2008.

R. Venkataramanan and S. S. Pradhan, "On Evaluating the Rate-distortion function of sources with feed-forward and the capacity of channels with feedback", Proc. IEEE Int. Symp. on Information Theory (ISIT), 2007.

R. Venkataramanan and S. S. Pradhan, "Directed Information for Communication Problems with Common Side Information and Delayed Feedback/Feedforward", Proc. of the 43rd Annual Allerton Conference on Communication, Control, and Computing, Sep. 2005.

R. Venkataramanan and S. S. Pradhan, "Source Coding with Feed-forward" Proc. IEEE Information Theory Workshop, San Antonio, Oct. 2004.

Copyright notice: Personal use of this material is permitted. However, permission to reprint/republish this material for advertising or promotional purposes or for creating new collective works for resale or redistribution to servers or lists, or to reuse any copyrighted component of this work in other works must be obtained from the copyright holders.