Parameterized approximation algorithm explained

A parameterized approximation algorithm is a type of algorithm that aims to find approximate solutions to NP-hard optimization problems in polynomial time in the input size and a function of a specific parameter. These algorithms are designed to combine the best aspects of both traditional approximation algorithms and fixed-parameter tractability.

In traditional approximation algorithms, the goal is to find solutions that are at most a certain factor away from the optimal solution, known as an -approximation, in polynomial time. On the other hand, parameterized algorithms are designed to find exact solutions to problems, but with the constraint that the running time of the algorithm is polynomial in the input size and a function of a specific parameter . The parameter describes some property of the input and is small in typical applications. The problem is said to be fixed-parameter tractable (FPT) if there is an algorithm that can find the optimum solution in

f(k)n ^{O(1)} time, where f(k) is a function independent of the input size .

A parameterized approximation algorithm aims to find a balance between these two approaches by finding approximate solutions in FPT time: the algorithm computes an -approximation in

f(k)n ^{O(1)} time, where f(k) is a function independent of the input size . This approach aims to overcome the limitations of both traditional approaches by having stronger guarantees on the solution quality compared to traditional approximations while still having efficient running times as in FPT algorithms. An overview of the research area studying parameterized approximation algorithms can be found in the survey of Marx^[1] and the more recent survey by Feldmann et al.^[2]

Obtainable approximation ratios

The full potential of parameterized approximation algorithms is utilized when a given optimization problem is shown to admit an -approximation algorithm running in

f(k)n ^{O(1)} time, while in contrast the problem neither has a polynomial-time -approximation algorithm (under some complexity assumption, e.g., P ≠ NP ), nor an FPT algorithm for the given parameter (i.e., it is at least W[1]-hard).

For example, some problems that are APX-hard and W[1]-hard admit a parameterized approximation scheme (PAS), i.e., for any

\varepsilon> 0 a ( 1+ \varepsilon) -approximation can be computed in f(k,\varepsilon)n ^{g(\varepsilon)} time for some functions and . This then circumvents the lower bounds in terms of polynomial-time approximation and fixed-parameter tractability. A PAS is similar in spirit to a polynomial-time approximation scheme (PTAS) but additionally exploits a given parameter . Since the degree of the polynomial in the runtime of a PAS depends on a function g(\varepsilon) , the value of \varepsilon is assumed to be arbitrary but constant in order for the PAS to run in FPT time. If this assumption is unsatisfying, \varepsilon is treated as a parameter as well to obtain an efficient parameterized approximation scheme (EPAS), which for any \varepsilon> 0 computes a ( 1+ \varepsilon) -approximation in f(k,\varepsilon)n ^{O(1)} time for some function . This is similar in spirit to an efficient polynomial-time approximation scheme (EPTAS).

k-cut

The k-cut problem has no polynomial-time

( 2- \varepsilon) -approximation algorithm for any \varepsilon> 0 , assuming P ≠ NP and the small set expansion hypothesis.^[3] It is also W[1]-hard parameterized by the number of required components.^[4] However an EPAS exists, which computes a ( 1+ \varepsilon) -approximation in (k/\varepsilon) ^{O(k)} n ^{O(1)} time.^[5]

Steiner Tree

The Steiner Tree problem is FPT parameterized by the number of terminals.^[6] However, for the "dual" parameter consisting of the number of non-terminals contained in the optimum solution, the problem is W[2]-hard (due to a folklore reduction from the Dominating Set problem). Steiner Tree is also known to be APX-hard.^[7] However, there is an EPAS computing a

( 1+ \varepsilon) -approximation in 2 ^{O(k ^{2/\varepsilon} ^{4)}} n ^{O(1)} time.^[8] The more general Steiner Forest problem is NP-hard on graphs of treewidth 3. However, on graphs of treewidth an EPAS can compute a ( 1+ \varepsilon) -approximation in 2 ^{O( (t ^{2})/(log (t)/(\varepsilon) ) \varepsilon)} n ^{O(1)} time.^[9]

Strongly-connected Steiner subgraph

It is known that the Strongly Connected Steiner Subgraph problem is W[1]-hard parameterized by the number of terminals,^[10] and also does not admit an

O( log ^{2-\varepsilon} n) -approximation in polynomial time (under standard complexity assumptions).^[11] However a 2-approximation can be computed in 3 ^{k} n ^{O(1)} time.^[12] Furthermore, this is best possible, since no ( 2- \varepsilon) -approximation can be computed in f(k)n ^{O(1)} time for any function, under Gap-ETH.^[13]

k-median and k-means

For the well-studied metric clustering problems of k-median and k-means parameterized by the number of centers, it is known that no

( 1+2 /e - \varepsilon) -approximation for k-Median and no ( 1+8 /e - \varepsilon) -approximation for k-Means can be computed in f(k)n ^{O(1)} time for any function, under Gap-ETH.^[14] Matching parameterized approximation algorithms exist, but it is not known whether matching approximations can be computed in polynomial time.

Clustering is often considered in settings of low dimensional data, and thus a practically relevant parameterization is by the dimension of the underlying metric. In the Euclidean space, the k-Median and k-Means problems admit an EPAS parameterized by the dimension,^{[15] [16]} and also an EPAS parameterized by .^{[17] [18]} The former was generalized to an EPAS for the parameterization by the doubling dimension.^[19] For the loosely related highway dimension parameter, only an approximation scheme with XP runtime is known to date.^[20]

k-center

For the metric k-center problem a 2-approximation can be computed in polynomial time. However, when parameterizing by either the number of centers,^[21] the doubling dimension (in fact the dimension of a Manhattan metric),^[22] or the highway dimension, no parameterized

( 2- \varepsilon) -approximation algorithm exists, under standard complexity assumptions. Furthermore, the k-Center problem is W[1]-hard even on planar graphs when simultaneously parameterizing it by the number of centers, the doubling dimension, the highway dimension, and the pathwidth.^[23] However, when combining with the doubling dimension an EPAS exists, and the same is true when combining with the highway dimension.^[24] For the more general version with vertex capacities, an EPAS exists for the parameterization by k and the doubling dimension, but not when using k and the highway dimension as the parameter.^[25] Regarding the pathwidth, k-Center admits an EPAS even for the more general treewidth parameter, and also for cliquewidth.^[26]

Densest subgraph

An optimization variant of the k-Clique problem is the Densest k-Subgraph problem (which is a 2-ary Constraint Satisfaction problem), where the task is to find a subgraph on vertices with maximum number of edges. It is not hard to obtain a

(k -1 ) -approximation by just picking a matching of size k/ 2 in the given input graph, since the maximum number of edges on vertices is always at most {k \choose 2 } = k(k -1 )/ 2 . This is also asymptotically optimal, since under Gap-ETH no k ^{1-o(1)} -approximation can be computed in FPT time parameterized by .^[27]

Dominating set

For the Dominating set problem it is W[1]-hard to compute any

g(k) -approximation in f(k)n ^{O(1)} time for any functions and .^[28]

Approximate kernelization

Kernelization is a technique used in fixed-parameter tractability to pre-process an instance of an NP-hard problem in order to remove "easy parts" and reveal the NP-hard core of the instance. A kernelization algorithm takes an instance and a parameter, and returns a new instance

I' with parameter k' such that the size of I' and k' is bounded as a function of the input parameter, and the algorithm runs in polynomial time. An -approximate kernelization algorithm is a variation of this technique that is used in parameterized approximation algorithms. It returns a kernel I' such that any -approximation in I' can be converted into an -approximation to the input instance in polynomial time. This notion was introduced by Lokshtanov et al.,^[29] but there are other related notions in the literature such as Turing kernels^[30] and -fidelity kernelization.^[31]

As for regular (non-approximate) kernels, a problem admits an α-approximate kernelization algorithm if and only if it has a parameterized α-approximation algorithm. The proof of this fact is very similar to the one for regular kernels. However the guaranteed approximate kernel might be of exponential size (or worse) in the input parameter. Hence it becomes interesting to find problems that admit polynomial sized approximate kernels. Furthermore, a polynomial-sized approximate kernelization scheme (PSAKS) is an -approximate kernelization algorithm that computes a polynomial-sized kernel and for which can be set to

1+ \varepsilon for any \varepsilon> 0 .

For example, while the Connected Vertex Cover problem is FPT parameterized by the solution size, it does not admit a (regular) polynomial sized kernel (unless

sf{NP}\subseteq sf{coNP/poly} ), but a PSAKS exists. Similarly, the Steiner Tree problem is FPT parameterized by the number of terminals, does not admit a polynomial sized kernel (unless sf{NP}\subseteq sf{coNP/poly} ), but a PSAKS exists. When parameterizing Steiner Tree by the number of non-terminals in the optimum solution, the problem is W[2]-hard (and thus admits no exact kernel at all, unless FPT=W[2]), but still admits a PSAKS.

Talks on parameterized approximations

• Daniel Lokshtanov: A Parameterized Approximation Scheme for k-Min Cut
• Tuukka Korhonen: Single-Exponential Time 2-Approximation Algorithm for Treewidth
• Karthik C. S.: Recent Hardness of Approximation results in Parameterized Complexity
• Ariel Kulik. Two-variable Recurrence Relations with Application to Parameterized Approximations
• Meirav Zehavi. FPT Approximation
• Vincent Cohen-Added: On the Parameterized Complexity of Various Clustering Problems
• Fahad Panolan. Parameterized Approximation for Independent Set of Rectangles
• Andreas Emil Feldmann. Approximate Kernelization Schemes for Steiner Networks

Notes and References

1. Marx . Daniel . 2008 . Parameterized Complexity and Approximation Algorithms . The Computer Journal . 51 . 1 . 60–78. 10.1093/comjnl/bxm048 .
2. Feldmann . Andreas Emil . Karthik C. S . Lee . Euiwoong . Manurangsi . Pasin . 2020 . A Survey on Approximation in Parameterized Complexity: Hardness and Algorithms . Algorithms . en . 13 . 6 . 146 . 10.3390/a13060146 . 1999-4893 . free . 2006.04411 .
3. Manurangsi . Pasin . 2018 . Inapproximability of Maximum Biclique Problems, Minimum k-Cut and Densest At-Least-k-Subgraph from the Small Set Expansion Hypothesis . Algorithms . en . 11 . 1 . 10 . 10.3390/a11010010 . 1999-4893 . free . 1705.03581 .
4. G. Downey . Rodney . Estivill-Castro . Vladimir . Fellows . Michael . Prieto . Elena . Elena Prieto-Rodriguez. Rosamund . Frances A. . 2003-04-01 . Cutting Up Is Hard To Do: The Parameterised Complexity of k-Cut and Related Problems . Electronic Notes in Theoretical Computer Science . CATS'03, Computing: the Australasian Theory Symposium . en . 78 . 209–222 . 10.1016/S1571-0661(04)81014-4 . 1571-0661. free . 10230/36518 . free .
5. Lokshtanov . Daniel . Saurabh . Saket . Surianarayanan . Vaishali . 2022-04-25 . A Parameterized Approximation Scheme for Min $k$-Cut . SIAM Journal on Computing . FOCS20–205 . 10.1137/20M1383197 . 2005.00134 . 0097-5397.
6. Dreyfus . S. E. . Wagner . R. A. . 1971 . The steiner problem in graphs . Networks . en . 1 . 3 . 195–207 . 10.1002/net.3230010302.
7. Chlebík . Miroslav . Chlebíková . Janka . 2008-10-31 . The Steiner tree problem on graphs: Inapproximability results . Theoretical Computer Science . Algorithmic Aspects of Global Computing . en . 406 . 3 . 207–214 . 10.1016/j.tcs.2008.06.046 . 0304-3975.
8. Dvořák . Pavel . Feldmann . Andreas E. . Knop . Dušan . Masařík . Tomáš . Toufar . Tomáš . Veselý . Pavel . 2021-01-01 . Parameterized Approximation Schemes for Steiner Trees with Small Number of Steiner Vertices . SIAM Journal on Discrete Mathematics . 35 . 1 . 546–574 . 10.1137/18M1209489 . 3581913 . 0895-4801. 1710.00668 .
9. Feldmann . Andreas Emil . Lampis . Michael . Bringmann . Karl . Grohe . Martin . Puppis . Gabriele . Svensson . Ola . 2402.09835 . Parameterized Algorithms for Steiner Forest in Bounded Width Graphs . 10.4230/LIPICS.ICALP.2024.61 . 61:1–61:20 . Schloss Dagstuhl – Leibniz-Zentrum für Informatik . LIPIcs . 51st International Colloquium on Automata, Languages, and Programming, ICALP 2024, July 8–12, 2024, Tallinn, Estonia . 297 . 2024. free .
10. Guo . Jiong . Niedermeier . Rolf . Suchý . Ondřej . 2011-01-01 . Parameterized Complexity of Arc-Weighted Directed Steiner Problems . SIAM Journal on Discrete Mathematics . 25 . 2 . 583–599 . 10.1137/100794560 . 0895-4801.
11. Book: Halperin . Eran . Krauthgamer . Robert . Proceedings of the thirty-fifth annual ACM symposium on Theory of computing . Polylogarithmic inapproximability . 2003-06-09 . https://doi.org/10.1145/780542.780628 . STOC '03 . New York, NY, USA . Association for Computing Machinery . 585–594 . 10.1145/780542.780628 . 978-1-58113-674-6. 8554166 .
12. Chitnis . Rajesh . Hajiaghayi . MohammadTaghi . Kortsarz . Guy . 2013 . Gutin . Gregory . Szeider . Stefan . Fixed-Parameter and Approximation Algorithms: A New Look . Parameterized and Exact Computation . Lecture Notes in Computer Science . 8246 . en . Cham . Springer International Publishing . 110–122 . 10.1007/978-3-319-03898-8_11 . 1308.3520 . 978-3-319-03898-8. 6796132 .
13. Chitnis . Rajesh . Feldmann . Andreas Emil . Manurangsi . Pasin . 2021-04-19 . Parameterized Approximation Algorithms for Bidirected Steiner Network Problems . ACM Transactions on Algorithms . 17 . 2 . 12:1–12:68 . 10.1145/3447584 . 235372580 . 1549-6325. 1707.06499 .
14. Cohen-Addad . Vincent . Gupta . Anupam . Kumar . Amit . Lee . Euiwoong . Li . Jason . 2019 . Baier . Christel . Chatzigiannakis . Ioannis . Flocchini . Paola . Leonardi . Stefano . Tight FPT Approximations for k-Median and k-Means . 46th International Colloquium on Automata, Languages, and Programming (ICALP 2019) . Leibniz International Proceedings in Informatics (LIPIcs) . Dagstuhl, Germany . Schloss Dagstuhl–Leibniz-Zentrum fuer Informatik . 132 . 42:1–42:14 . 10.4230/LIPIcs.ICALP.2019.42 . free . 978-3-95977-109-2. 139103417 .
15. Kolliopoulos . Stavros G. . A Nearly Linear-Time Approximation Scheme for the Euclidean k-median Problem . 1999 . Algorithms - ESA' 99 . 1643 . 378–389 . Nešetřil . Jaroslav . Berlin, Heidelberg . Springer Berlin Heidelberg . 10.1007/3-540-48481-7_33 . 978-3-540-66251-8 . Rao . Satish. Lecture Notes in Computer Science .
16. Cohen-Addad . Vincent . A Fast Approximation Scheme for Low-Dimensional k-Means . 2018 . Proceedings of the 2018 Annual ACM-SIAM Symposium on Discrete Algorithms (SODA) . 430–440 . Proceedings . Society for Industrial and Applied Mathematics . 10.1137/1.9781611975031.29 . 978-1-61197-503-1 . 30474859. 1708.07381 .
17. Book: Feldman . Dan . Monemizadeh . Morteza . Sohler . Christian . Proceedings of the twenty-third annual symposium on Computational geometry - SCG '07 . A PTAS for k-means clustering based on weak coresets . 2007-06-06 . https://doi.org/10.1145/1247069.1247072 . New York, NY, USA . Association for Computing Machinery . 11–18 . 10.1145/1247069.1247072 . 978-1-59593-705-6. 5694112 .
18. Book: Feldman . Dan . Langberg . Michael . Proceedings of the forty-third annual ACM symposium on Theory of computing . A unified framework for approximating and clustering data . 2011-06-06 . https://doi.org/10.1145/1993636.1993712 . STOC '11 . New York, NY, USA . Association for Computing Machinery . 569–578 . 10.1145/1993636.1993712 . 978-1-4503-0691-1. 2677556 .
19. Cohen-Addad . Vincent . Feldmann . Andreas Emil . Saulpic . David . 2021-10-31 . Near-linear Time Approximation Schemes for Clustering in Doubling Metrics . Journal of the ACM . 68 . 6 . 44:1–44:34 . 10.1145/3477541 . 1812.08664 . 240476191 . 0004-5411.
20. Feldmann . Andreas Emil . Saulpic . David . 2021-12-01 . Polynomial time approximation schemes for clustering in low highway dimension graphs . Journal of Computer and System Sciences . en . 122 . 72–93 . 10.1016/j.jcss.2021.06.002 . 0022-0000.
21. Feldmann . Andreas Emil . 2019-03-01 . Fixed-Parameter Approximations for k-Center Problems in Low Highway Dimension Graphs . Algorithmica . en . 81 . 3 . 1031–1052 . 10.1007/s00453-018-0455-0 . 1605.02530 . 46886829 . 1432-0541.
22. Book: Feder . Tomás . Greene . Daniel . Proceedings of the twentieth annual ACM symposium on Theory of computing - STOC '88 . Optimal algorithms for approximate clustering . 1988-01-01 . https://doi.org/10.1145/62212.62255 . New York, NY, USA . Association for Computing Machinery . 434–444 . 10.1145/62212.62255 . 978-0-89791-264-8. 658151 .
23. Feldmann . Andreas Emil . Marx . Dániel . 2020-07-01 . The Parameterized Hardness of the k-Center Problem in Transportation Networks . Algorithmica . en . 82 . 7 . 1989–2005 . 10.1007/s00453-020-00683-w . 3532236 . 1432-0541. 1802.08563 .
24. Becker . Amariah . Klein . Philip N. . Saulpic . David . 2018 . Azar . Yossi . Bast . Hannah . Herman . Grzegorz . Polynomial-Time Approximation Schemes for k-center, k-median, and Capacitated Vehicle Routing in Bounded Highway Dimension . 26th Annual European Symposium on Algorithms (ESA 2018) . Leibniz International Proceedings in Informatics (LIPIcs) . Dagstuhl, Germany . Schloss Dagstuhl–Leibniz-Zentrum fuer Informatik . 112 . 8:1–8:15 . 10.4230/LIPIcs.ESA.2018.8 . free . 978-3-95977-081-1.
25. Feldmann . Andreas Emil . Vu . Tung Anh . 2022 . Bekos . Michael A. . Kaufmann . Michael . Generalized -Center: Distinguishing Doubling and Highway Dimension . Graph-Theoretic Concepts in Computer Science . Lecture Notes in Computer Science . 13453 . en . Cham . Springer International Publishing . 215–229 . 10.1007/978-3-031-15914-5_16 . 2209.00675 . 978-3-031-15914-5.
26. Katsikarelis . Ioannis . Lampis . Michael . Paschos . Vangelis Th. . 2019-07-15 . Structural parameters, tight bounds, and approximation for (k,r)-center . Discrete Applied Mathematics . Combinatorial Optimization: between Practice and Theory . en . 264 . 90–117 . 10.1016/j.dam.2018.11.002 . 0166-218X. 1704.08868 .
27. Dinur . Irit . Manurangsi . Pasin . 2018 . Karlin . Anna R. . ETH-Hardness of Approximating 2-CSPs and Directed Steiner Network . 9th Innovations in Theoretical Computer Science Conference (ITCS 2018) . Leibniz International Proceedings in Informatics (LIPIcs) . Dagstuhl, Germany . Schloss Dagstuhl–Leibniz-Zentrum fuer Informatik . 94 . 36:1–36:20 . 10.4230/LIPIcs.ITCS.2018.36 . free . 978-3-95977-060-6. 4681120 .
28. Book: S. . Karthik C. . Laekhanukit . Bundit . Manurangsi . Pasin . Proceedings of the 50th Annual ACM SIGACT Symposium on Theory of Computing . On the parameterized complexity of approximating dominating set . 2018-06-20 . https://doi.org/10.1145/3188745.3188896 . STOC 2018 . New York, NY, USA . Association for Computing Machinery . 1283–1296 . 10.1145/3188745.3188896 . 1711.11029 . 978-1-4503-5559-9. 3170316 .
29. Book: Lokshtanov . Daniel . Panolan . Fahad . Ramanujan . M. S. . Saurabh . Saket . Proceedings of the 49th Annual ACM SIGACT Symposium on Theory of Computing . Lossy kernelization . 2017-06-19 . https://doi.org/10.1145/3055399.3055456 . STOC 2017 . New York, NY, USA . Association for Computing Machinery . 224–237 . 10.1145/3055399.3055456 . 978-1-4503-4528-6. 14599219 .
30. Hermelin . Danny . Kratsch . Stefan . Sołtys . Karolina . Wahlström . Magnus . Wu . Xi . 2015-03-01 . A Completeness Theory for Polynomial (Turing) Kernelization . Algorithmica . en . 71 . 3 . 702–730 . 10.1007/s00453-014-9910-8 . 253973283 . 1432-0541.
31. Fellows . Michael R. . Kulik . Ariel . Rosamond . Frances . Shachnai . Hadas . Hadas Shachnai . 2018-05-01 . Parameterized approximation via fidelity preserving transformations . Journal of Computer and System Sciences . en . 93 . 30–40 . 10.1016/j.jcss.2017.11.001 . 0022-0000.